Senior Data QC Engineer in Softserve

SoftServe is a global digital solutions company with headquarters in Austin, Texas, founded in 1993. Our associates work on 2,000+ projects with clients across North America, EMEA, APAC, and LATAM. We are about people who create bold things, make a difference, have fun, and love their work.

Big Data & Analytics Center of Excellence is a data consulting and data engineering branch at SoftServe. Starting as a group of three enthusiasts back in 2013, hundreds of Data Engineers and Architects nowadays build Data & Analytics end-to-end solutions from strategy through technical design and PoC to full-scale implementation. We have customers in the Healthcare, Finance, Manufacturing, Retail, and Energy domains.

We hold top-level partnership statuses with all the major cloud providers and collaborate with many technology partners like AWS, GCP, Microsoft, Databricks, Snowflake, Confluent, and others.

• Check data for errors, missing values, or inconsistencies
• Use SQL to run queries and ensure data is correct
• Test data as it moves through ETL pipelines
• Work with data engineers and analysts to fix data issues
• Write clear reports about any data issues found
• Help create automated tests to check data quality
• Use Python or Java to write simple scripts for testing
• Be part of a team of data-focused engineers dedicated to continuous learning, improvement, and knowledge-sharing
• Work with a cutting-edge technology stack, including pioneering services from major cloud providers
• Engage with customers ranging from large global corporations to emerging start-ups launching their first product
• Be involved in the entire project lifecycle from initial design and proof of concept (PoC) to minimum viable product (MVP) development and full-scale implementation

• Experienced in quality assurance or a related field with a specialization in data testing
• Strong in SQL for querying and validating large-scale datasets
• Proficient in ETL processes and testing data pipelines using tools like Airflow or Google Composer
• Familiar with data warehousing concepts, including Snowflake, BigQuery, and Redshift
• Experienced in API testing using tools such as Postman and Swagger
• Proficient in data quality practice,s including profiling, metric calculation, and validation of completeness, consistency, integrity, timeliness, uniqueness, and accuracy
• Adept at using automated testing frameworks for data validation, such as pytest or Great Expectations
• Aware of scripting and task automation using Python or Java
• Strong in analytics to identify patterns and detect data anomalies
• Skilled in big data technologies such as Hadoop, Spark, or Kafka (a plus)

• Address different business and technology challenges, engage in impactful projects, use top-notch technologies, and drive multiple initiatives as a part of the Center of Excellence
• Support your technical and personal growth — we have a dedicated career plan for all roles in our company
• Investigate new technologies, build internal prototypes, and share knowledge with SoftServe Data Community
• Upskill with full access to Udemy learning courses
• Pass professional certifications, encouraged and covered by the company
• Adopt best practices from experts while working in a team of top-notch engineers and architects
• Collaborate with world-leading companies and attend professional events