Principal Engineer, Data Engineering (Data Solution)
SymphonyAI
Software Engineering, Data Science
Bengaluru, Karnataka, India
Principal Engineer, Data Engineering (Data Solution)
- Category
- Software Engineering
- Position Type
- Full-Time
Introduction
Job Title:
Data Solutions - Architect (Data Engineering Architect)
Department:
Engineering / Data Platform
Overview:
IRIS Foundry Data Platform at SymphonyAI enables robust, scalable, and resilient data pipelines for diverse enterprise datasets. We are seeking an Architect with extensive experience in Data Platform infrastructure and products to architect, implement, and maintain high-uptime data pipelines for datasets supported by IRIS Foundry. This role works closely with product, engineering, and customer teams to ensure 99.9% uptime, rapid adoption of new features, seamless troubleshooting, and consistently delivers on customer roadmaps. The Architect will independently lead a small team of senior, mid-senior, or junior engineers to realize customer deliveries and solutions.
Job Description
Responsibilities:
- Collect data requirements from Professional Services and negotiate the data acquisition strategy with customers to bring in diverse datasets (time series, tabular, document stores).
- Understand IRIS Foundry Data Platform capabilities and update supported data pipeline templates to leverage new product features.
- Communicate and coordinate with the customer engagement team to understand and plan for upcoming deliverables and PoCs, preparing timelines for delivery.
- Attend customer meetings, analyze customer architecture, propose data pipeline options, ask diagnostic questions, and collect information to inform template decisions.
- Analyze datasets to incorporate necessary data clean-up and preprocessing steps into the pipeline.
- Propose, implement, and update monitoring and alerting rules for all data pipelines; coordinate with backend/devops teams for L2 support.
- Guide stakeholders during customer-driven changes and plan downstream modifications to avoid disruptions in data ingestion.
- Establish best practices for writing and automating component tests for data pipelines.
Expected Outcomes:
- Achieve and maintain 99.9% uptime for data ingestion pipelines.
- Reduce data disruptions through improved monitoring and alerting.
- Configure custom monitoring dashboards for tenants in multi-tenant cloud environments.
- Proactively identify bottlenecks and suggest improvements for the product roadmap.
Required Skills & Qualifications:
- Experience working with ETL/ELT data pipelines using open source or enterprise platforms.
- Understanding of cloud-native services like Azure, AWS, or GCP.
- Knowledge of SQL databases (e.g., Postgres), NoSQL databases (e.g., MongoDB, Elasticsearch), and messaging systems (e.g., Azure queues, Event Hubs).
- Hands-on coding and debugging skills with Python, Groovy, and Java.
- Prior experience with containerization (Docker, Kubernetes) and CI/CD pipelines.
- Experience with workflow orchestration tools such as Apache NiFi, Apache Airflow, or comparable orchestration frameworks.
- Familiarity with monitoring and visualization tools (Prometheus, Grafana, Kibana) is preferred.
- Comfortable using GenAI tools (e.g., Cursor) as an assistant to rapidly build, test, and automate data pipeline deployment.
- Knowledge of industrial database historians (OSI PI, AspenTech IP.21, Wonderware, etc.) is a huge plus.
What We Offer:
- Competitive salary and benefits package.
- Flexible hybrid working model.
- Opportunities for professional growth and development.
- Collaborative and inclusive work environment.
- Access to the latest technologies and tools.
Hybrid/On-site Requirements:
Flexible hybrid working model
Compensation & Benefits:
Competitive salary and benefits package
Diversity & Inclusion Statement:
We are committed to building a diverse and inclusive team and encourage candidates from all backgrounds to apply.
About Us
SymphonyAI is building the leading enterprise AI SaaS company for digital transformation across the most critical and resilient growth industries, including retail, consumer packaged goods, financial crime prevention, manufacturing, media, and IT service management. Since its founding in 2017, SymphonyAI today serves 1500+ Enterprise customers globally and has grown to 3,000 talented leaders, data scientists, and other professionals across over 30 countries.
Options
Software Powered by iCIMS
www.icims.com