Python Data Engineer in Codster

Codster is a technology-driven company, our goal is to create the best digital experience for our customers by combining technology, engineering, and talented people.

As an AWS Partner, all our applications are cloud-native. AWS provides a comprehensive suite of services and solutions to develop and run sophisticated and scalable applications. Running your applications in the AWS Cloud can help you move faster, operate more securely, and save substantial costs; all while benefiting from the agility, scale, and performance of the cloud.

At Codster we focus on being innovative, developing solutions through revolutionary technologies, as AWS partners, we look for the cloud adoption within organizations. We are looking for a highly-skilled, professional technical manager to join our dynamic and growing team. In this position, you will oversee all technical matters companywide and manage our technical support team.

• Write effective, scalable code using Python and Big Data frameworks
• Create and maintain optimal data pipeline architecture
• Ability to design solutions independently based on high-level architecture.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL/NoSQL and AWS ‘big data’ technologies such as AWS Glue, AWS Athena and AWS S3.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Coordinate with internal teams to understand user requirements and provide technical solutions

• 4+ years of proven experience as a Python Developer
  • Experience with Apache Spark big data tool
  • Experience with relational SQL and NoSQL databases.
  • Experience with stream-processing systems: Storm, Spark-Streaming, etc.
  • Experience with API Integrations
• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
• Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
• Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
• Excellent communication and teamwork skills
• Great attention to detail
• Organizational skills

• Optional: Experience with AWS cloud services: EC2, RDS, AWS Glue, AWS Athena, Quicksight, etc
• Optional: Familiar with Agile methodologies

Access to self-learning courses in AWS