Python scripts for parsing, cleaning and transforming structured and semi-structured data. Perl pipelines for MySQL-to-PostgreSQL migrations with schema mapping and integrity validation. Bash orchestration scripts with logging, error handling and automatic recovery.
Python handles the parsing and transformation of the data: reading CSV, XML and MySQL databases through specialized connectors, cleaning with pandas (deduplication, format normalization, anomaly detection), and exporting to the target format. The scripts are configurable to process different sources without modifying the code.
Perl comes in specifically for MySQL-to-PostgreSQL migrations, where mapping data types and SQL syntax requires fine-grained text processing (complex regexes for converting schemas, stored procedures, triggers). Bash scripts orchestrate the whole thing: sequencing the steps, detailed logging, and error handling with automatic recovery from the last checkpoint.
Python scripts for extraction, transformation and loading (ETL).
Migrations between MySQL and PostgreSQL with validation.
Perl scripts for processing complex text files.
Bash automation for pipeline orchestration.
Database connectors for extraction and loading.
Extraction and transformation
Advanced scripting
MySQL and PostgreSQL
A brief, a repo, or a quick call - whatever works.