I was trying to remove the svg's without altering how the grid works.
The svgs are used to achieve an aspect-ratio of 1 for all tiles.
EDIT: Seems like there is a CSS Solution for this.
simply had to set aspect-ratio: 1 for my tiles.
This seems to be really new is there another solution for this other than using the svg hack?
body>div {
  display: grid;
  grid-gap: 10px;
  grid-template-columns: repeat(auto-fit, minmax(200px, 1fr));
  min-width: 700px
}
div div {
  background: red;
}<div>
  <div><svg viewBox="0 0 1 1"></svg></div>
  <div><svg viewBox="0 0 1 1"></svg></div>
  <div><svg viewBox="0 0 1 1"></svg></div>
  <div><svg viewBox="0 0 1 1"></svg></div>
  <div><svg viewBox="0 0 1 1"></svg></div>
  <div><svg viewBox="0 0 1 1"></svg></div>
  <div><svg viewBox="0 0 1 1"></svg></div>
  <div><svg viewBox="0 0 1 1"></svg></div>
  <div><svg viewBox="0 0 1 1"></svg></div>
  <div><svg viewBox="0 0 1 1"></svg></div>
  <div><svg viewBox="0 0 1 1"></svg></div>
  <div><svg viewBox="0 0 1 1"></svg></div>
  <div><svg viewBox="0 0 1 1"></svg></div>
  <div><svg viewBox="0 0 1 1"></svg></div>
  <div><svg viewBox="0 0 1 1"></svg></div>
  <div><svg viewBox="0 0 1 1"></svg></div>
  <div><svg viewBox="0 0 1 1"></svg></div>
  <div><svg viewBox="0 0 1 1"></svg></div>
  <div><svg viewBox="0 0 1 1"></svg></div>
  <div><svg viewBox="0 0 1 1"></svg></div>
  <div><svg viewBox="0 0 1 1"></svg></div>
  <div><svg viewBox="0 0 1 1"></svg></div>
  <div><svg viewBox="0 0 1 1"></svg></div>
  <div><svg viewBox="0 0 1 1"></svg></div>
  <div><svg viewBox="0 0 1 1"></svg></div>
  <div><svg viewBox="0 0 1 1"></svg></div>
  <div><svg viewBox="0 0 1 1"></svg></div>
  <div><svg viewBox="0 0 1 1"></svg></div>
  <div><svg viewBox="0 0 1 1"></svg></div>
  <div><svg viewBox="0 0 1 1"></svg></div>
</div> 
    