Far off Knowledge Engineer at Pagos.ai

In regards to the Position

As a Knowledge Engineer, you’ll play a key section in development and keeping up the platform that powers our merchandise. By means of taking part with backend engineers, information analysts, and different engineers, you’ll construct and personal new options, modules, and extensions of our programs. We’re in quest of an action-oriented and collaborative downside solver who prospers in ambiguity and will tackle new demanding situations with optimism in a fast paced setting. We price crew individuals who don’t seem to be best professional of their space of experience however also are perpetual newbies who’re dedicated to progress and contributing to our collective good fortune.

On this position, you’re going to:

• Craft high quality code for scale, availability, and function
• Design, increase, and deal with scalable information pipelines and processes to extract, procedure, and turn into huge volumes of knowledge, each real-time and batched (ELT/ETL)
• Construct and deal with integrations with information suppliers the usage of quite a lot of information switch protocols
• Power engineering tasks from begin to end with a excessive stage of possession and autonomy
• Ensure that the standard of our merchandise and knowledge thru each guide and automatic trying out, in addition to code critiques

We’re searching for anyone with:

• 8+ years of tool engineering enjoy with an emphasis on Knowledge Engineering
• Bachelor’s stage or upper in Pc Science or connected technical self-discipline (or an identical enjoy)
• Complicated enjoy with complicated SQL queries and database/lakehouse applied sciences comparable to Redshift, Apache Iceberg and Postgres
• Deep enjoy with giant information applied sciences and frameworks comparable to Apache Spark, DBT, in addition to information high quality equipment, like DBT (take a look at)
• Familiarity with cloud platforms like AWS, GCP, or Azure, and not unusual data-related services and products (e.g. S3, Redshift, EMR, Glue, Kinesis, Athena)
• A bias for motion, the place no job is simply too small, and a zeal to be told and develop with our business

Great to have: 

• Enjoy with real-time streaming frameworks like Apache Kafka
• Enjoy with Nice Expectancies and/or Soda
• Convenience and/or previous enjoy operating and managing giant information and ELT pipelines
• Convenience and/or previous enjoy operating with Temporal, Apache Airflow or equivalent orchestration equipment
• Enjoy operating in high-growth, venture-backed startup(s)