By Louise de Leyritz from Castor (www.castordoc.com)
The raw data collected by companies is usually messy and unusable for data analysis. Data has to be transformed, so it can be made conducive to value-generating data analysis.
This explains the recent explosion of data transformation tools (internal, open-source, and SaaS). This new trend is not going to stop, and we'd rather bring visibility and structure soon.
/w=1920,quality=90,fit=scale-down)
At CastorDoc, we believe the first step to structure the data transformation tools market, is more transparency. For that reason, we put up a list of all the data modeling tools we heard of.
Get started on Data Modeling Tools
This list is still exploratory, may contain errors, or lack information. Please reach out to us, if you notice anything wrong: louise@castordoc.com.
In-depth analysis and evolution
Read the full breakdown by generation and market analysis of data transformation here
Deeper dive into SQL Editors
‣
| Name | Website | Deployment | Classification | Security | language | features | Community | data sources supported |
|---|---|---|---|---|---|---|---|---|
Dataform 🇬🇧 | SaaS | Transformation only | Hosted on google cloud platform | No-codeSQL | RedshiftBigQuerySnowflakeAzure SQLPostgresSQL | |||
Modlr 🇦🇺 | SaaS | Transformation part of larger offering | No-code | Dashboard customisation | ||||
Trifacta 🇺🇸 | SaaS | Transformation only | SOC 2 compliant | SQLNo-code | Data visualization | RedshiftSnowflakeBigQuery | ||
Rudderstack 🇺🇸 | Open-source | Transformation part of larger offering | SQL | Real-time transformations | RedshiftBigQuerySnowflakePostgresSQLClickhouse | |||
Matillion 🇬🇧 | SaaS | Transformation part of larger offering | SOC 2 compliantHIPAACSA STAR | SQLNo-code | RedshiftBigQuerySnowflake | |||
Easymorph 🇨🇦 | SaaS | Transformation part of larger offeringETL tool | No-code | 120 built-in transforms | ||||
Paxata 🇺🇸 | SaaS | Transformation part of larger offering | No-code | |||||
Rockset 🇺🇸 | SaaS | Transformation only | SQL | Real-time transformations | MongoDBDynamoDBPostgresSQLMySQLS3GCSKafka | |||
Beam | Open-source | Transformation part of larger offering | SQL | |||||
Dbt 🇺🇸 | Open-source | Transformation only | SOC 2 compliant | SQL | Git integrationsversion controlloggingmodularityreference one data model within another | RedshiftPostgresSQLSnowflake | ||
Mara | Open-source | |||||||
Zillion | Open-source | |||||||
Glue 🇺🇸 | SaaS | Transformation part of larger offering | ScalaPython | |||||
Airflow | Open-source | Transformation part of larger offering | Quality checks |