Vabljeni na predavanje »Usage of AWS in data engineering«, ki ga bosta pri predmetu Big data imela Anžej Curk in Denis Turšić iz podjetja Result, v sredo, 8. 5. 2024, ob 14.15 v P20 na FRI.

Naslov:
Usage of AWS in data engineering (what we have learned in several years usage of AWS as a central data platform service)

Povzetek predavanja:
Present the crucial AWS services that we use daily to build infrastructure on AWS and utilize it as a central data platform. We will share tips and tricks regarding AWS usage, such as hidden costs and how to manage your infrastructure effectively. Additionally, we will discuss the pros and cons of using public cloud providers compared to on-premises solutions. We'll explore best practices for AWS usage and emphasize the importance of predicting your infrastructure requirements in advance for a given problem. When working with AWS and public cloud providers, it's essential to choose the correct tools for testing, development, and deployment of your infrastructure. We'll also showcase real problems and solutions we've encountered during our development in AWS, including cost optimization and performance issues.

• Anžej Curk, data engineer. Working with data-related systems for more than 10 years. I have started my professional career as a Java and Pl/SQL developer  (DWH in Oracle). I have started working with AWS more than 5 years ago (to build infrastructure). I have experience in data engineering, database development and BI. These are just a few technologies/processes that I'm using in my everyday work (Python, Code as an infrastructure (Terraform) and CI/CD, Data modelling (relational and event-based systems), ETL solutions, SQL, Java, Docker …).
• Denis Turšič, data engineer. Started working with AWS for more than 3 years. I’m a full-stack data engineer (building infrastructure on AWS and developing solutions to ingest, transform and validate data in central data platforms). Daily, I use those technologies: Python, Code as an infrastructure (Terraform) and CI/CD, Docker, Kubernetes.