CV: Data Engineer, DBA
только зарегистрированным пользователям.
Database Migration from Oracle to Postgres using Kafka Streaming and Debezium Change Data
Capture
- Created and administrated databases in Oracle and Postgres: user control access, from diagram to
SQL code, Oracle to Postgres conversion, backup/restore.
- Implemented Bash scripts to export Oracle DB tables into CSV files and copy them to an AWS S3
bucket folder.
- Implemented procedures, functions, views, and triggers in Postgres and Oracle.
- Implemented Python scripts to populate Oracle DB with dummy data, exporting and migrating it
from AWS S3 to Postgres.
- Configured, created a Kafka Cluster, and tested its functionality.
- Used Debezium Connector for Oracle and JDBC Sink to create source and sink connectors.
- Created an ETL pipeline to provide consistent daily data.
- Used Postman to identify and validate REST APIs endpoints before issuing requests and
obtaining JSON-formatted responses.
- Created Python scripts to transform data and store it in a Postgres database.
- Orchestrated and managed execution of workflow operations using Apache Airflow DAGs.
- Developed Python scripts for web scraping, data cleaning, transformation and analysis.
- Created an ETL pipeline and deployed it as a DAG with Airflow in AWS.
- One such project involved web scraping data from the AutoScout24 website to extract vehicle
details and save to AWS RDS.
- Created a new website for the hospital from scratch using WordPress.
- Maintained the website, including regular backups and updates.
- Offered troubleshooting, plugin customization, and performance optimization.
- Implemented responsive and user-friendly web-pages using HTML, CSS, and JavaScript to
enhance website functionality and user experience.
- SQL Server 2012
- Reports, creation of new procedures, editing of old ones according to the norms and
legislation.
- Optimised workflows as required by the hospital staff.
Специальность: Computers and Informational Technologies.
- Python
- PostgreSQL
- Oracle Database
- PL/SQL
- Amazon S3 , Amazon EC2
- Data Migration
- Git
-. Bash
- Apache Airflow
- Docker