If you were forwarded this newsletter, and you'd like to receive it in the future, subscribe here.​

​One Line of Code Can Wipe a Billion Rows : Investing in Tobiko​

One line of software can impact a billion rows of data.

A short SQL statement can delete a table, reformat date into the US format, or compute the average quota attainment by account executive by region over a company’s history.

As data has become a critical component of analytics & production systems, data engineers require more sophisticated tools to manage their data transformations.

Tobiko is that solution.

Tobiko enables modern data transformations by calculating only what’s needed.

At small scale this may not seem important. But for Harness, this innovation saved 30-40% of their cloud data warehouse spend & reduced model build time by 80%. DreamHaven, a gaming company, found Databricks’s Delta Live Tables 3.5x more expensive than Tobiko to run the same pipelines.

Existing systems recalculate too much because they don’t understand data lineage & the relationships between tables. So they recalculate too much data to ensure correctness, substantially increasing data warehouse spend.

More than that, Tobiko enables data engineers to operate with the same discipline as software developers: creating development environments, writing tests to ensure code performs as intended, & simulating changes to ensure one line of code doesn’t wipe a billion rows.

Initially, Pipe planned to have multiple Databricks environments : dev, prod, and staging. They wanted to segregate the data; however, with Tobiko’s architecture, they only needed one environment. This simplified their architecture & reduced cost.

Migration is straightforward : Tobiko’s platform is DBT compatible out-of-the-box.

Tobiko is founded by a team from Airbnb, Netflix, Google, & Apple who have faced the challenges of scaling data infrastructure & developed tools to solve the problems they faced.

We’re excited to partner with Toby, Tyson, & Iaroslav by leading their Series A financing, alongside Unusual Ventures, Jordan Tigani from MotherDuck & George Fraser from FiveTran.

If you’re interested to learn more about Tobiko & the modern way to shape data, talk to the team here.

​