Your mission
You build the fundaments for our AI systems!
You collaborate with Data Scientists, Machine Learning Engineers, and product development to preprocess, analyze, and prepare data for modeling
You design, build and optimize the data infrastructure, including efficient data storage and processing
You deal with large structured and unstructured datasets (1M rows, 1TB of various document types) → Buzzwords: Spark, MapReduce, Hadoop, Distributed Computing, Parquet (Data format)
You do testing and evaluation on the data setup
And in case you аrе curious the following task might hook you up:
Releasing new model versions to our development and production systems
Monitoring our models and systems Data drift, Feature Store, Model Registry, MLFlow
Automating the way Machine Learning and AI solutions get in production!