We manage the entire Extract, Transform, and Load (ETL) process for Redshift, saving your analysts the pain of having to deal with reoccurring headaches and making them more productive writing queries and exploring your data. Some of the optimizations we do are:
- Data Vacuuming: Cleaning up deleted data and reorganizing it into the right order so that queries are much faster.
- Compressing Data: We use a compression algorithm optimal for each column that also makes queries much faster.
- Handling non-UTF-8: Special formatting done so that uploads do not fail.
- Field Truncation: If the property value is too long we truncate it and make sure it stays in JSON format so that uploads do not fail.