NJSC “Social Health Insurance Fund” — Senior Data Engineer
Вакансия жабылды
Бет анықтама үшін сақталды, бірақ жұмыс беруші енді өтінім қабылдамайды.
Senior Data Engineer
NJSC “Social Health Insurance Fund”
1,500,000 to 2,000,000 KZT Gross per month
Astana, on-site
The compulsory medical insurance system operator ensures the provision of medical care to the population.
Responsibilities:
• Building and developing the data layer for a unified AI platform of the Fund.
• Integrating DWH, internal information systems, documents, and other data sources.
• Developing ETL/ELT pipelines, data marts, and data quality control mechanisms.
• Preparing reproducible training datasets and features for ML models.
• Preparing and maintaining data delivery pipelines in production in collaboration with MLOps/LLMOps.
• Forming sources for RAG: regulations, internal documents, knowledge bases, metadata, updating and indexing documents.
• Organizing access control, data storage, and auditing.
Requirements:
• 4+ years of experience as a Data Engineer
• Proficient in SQL and Python
• Experience in designing DWH, data marts, and integration solutions
• Practical experience in building ETL/ELT pipelines using Airflow, Dagster, Prefect or similar
• Knowledge of PostgreSQL, ClickHouse, MS SQL, Oracle or similar DBMS
• Experience working with APIs, message queues, and file storage
• Understanding of data quality, data lineage, metadata management, and data access
• Experience processing unstructured documents and preparing data for search/RAG.
Optional requirements:
• Experience with Kafka, Debezium, dbt, Spark, MinIO/S3
• Experience with Qdrant, OpenSearch/Elasticsearch or other search and vector databases
• Experience working with government, medical, or insurance data
• Understanding of information security requirements and working in closed environments.
Пікірлер