We manage the entire Extract, Transform, and Load (ETL) process for data loaded to your Redshift, saving your analysts the pain of having to deal with reoccurring headaches and making them more productive with writing queries and exploring your data. Some of the optimizations we do before loading data are:
- Data Vacuuming: Cleaning up deleted data and reorganizing it into the right order so that queries are much faster.
- Compressing Data: We use a compression algorithm optimized for each column that also makes queries much faster.
- Handling non-UTF-8: Special formatting done so that uploads do not fail.
- Field Truncation: If the property value is too long we truncate it and make sure it stays in JSON format so that uploads do not fail.
Important Note: The optimizations are performed on Amplitude data only. We will not perform maintenance on your Redshift cluster.