Apache NiFi Data Integration Specialist

We are looking for an experienced Senior Data Engineer with strong hands-on expertise in Apache NiFi and PySpark to support enterprise-grade data engineering initiatives.
If you have experience building scalable data pipelines, handling complex data processing workflows, and delivering reliable, production-ready data solutions, we would like to connect with you!
Technical Skills Required
Primary Skills (Must-Have)
• Apache NiFi – Expert-level experience
• PySpark – Expert-level experience
Workflow Orchestration
• Apache Airflow
Big Data & Cloud Ecosystem
• Hadoop
• Azure Databricks
• AWS EMR
• Azure Synapse Analytics
What We Are Looking For
We need a resource who can:
• Design, develop, and implement enterprise-grade data ingestion and processing pipelines.
• Build and manage scalable batch and real-time data processing solutions.
• Develop and optimize complex PySpark applications.
• Build and manage data workflows using Apache NiFi and Airflow.
• Independently take ownership of assigned tasks and drive them through completion.
• Troubleshoot technical challenges and deliver solutions with minimal supervision.
• Collaborate effectively with distributed teams and adapt to changing project requirements.
We are looking for someone who can own the work end-to-end, rather than someone who requires continuous guidance.

---
來源：Freelancer.com | 出價次數：1 | 剩餘時間：6 日 | 專案類型：固定預算