Director - Data Engineering

Corporate Forex
Bengaluru
Not disclosed
Work from OfficeWork from Office
Full TimeFull Time
Min. 12 yearsMin. 12 years

Job Description

Director - Data Engineering

Our engineering team defines the technical architecture and drives itself to build systems that serve billions of requests per day, cosmic scales of video content streamed every day, with ultra-low latency design and high reliability. We make sure every byte of video content gets to millions of viewers, at the highest quality possible. We are growing fast and looking for talented Engineers who are up for one of the biggest yet outcomes in the video streaming business as we gun to be the primary destination for digital first entertainment in India and make JioCinema accessible to every Indian.

What will you do?

  • Leadership and Team Management:
  • Team Leadership: Provide strong leadership to the data engineering team, fostering a collaborative and innovative work environment.
  • Strategic Vision: Align data engineering initiatives with business goals, demonstrating strategic thinking and long-term vision.
  • Stakeholder Collaboration: Exhibit excellent communication skills for effective collaboration with stakeholders at all levels of the organization.
  • Data Engineering Fundamentals:
  • ETL/ELT Processes: Lead the design and implementation of robust ETL/ELT pipelines to ensure efficient data extraction, transformation, and loading processes.
  • Data Modeling: Apply expertise in data modeling, including relational, dimensional, and NoSQL data modeling, to structure data effectively.
  • Database Management: Oversee the management and optimization of various database systems such as SQL (e.g., MySQL, PostgreSQL, SQL Server) and NoSQL (e.g., MongoDB, Cassandra) databases.
  • Big Data Technologies:
  • Hadoop Ecosystem: Guide the utilization of Hadoop components like HDFS, MapReduce, Hive, Pig, and HBase for large-scale data storage and processing.
  • Spark: Champion the implementation of Apache Spark for advanced, large-scale data processing.
  • Stream Processing: Lead the adoption of real-time data processing frameworks such as Apache Kafka and Apache Flink for streaming data applications.
  • Cloud Platforms:
  • AWS: Leverage AWS services including S3, Redshift, EMR, Glue, and Lambda for cloud-based data solutions.
  • Azure: Utilize Azure Data Lake, Azure Synapse, and Azure Data Factory for scalable data processing.
  • Google Cloud Platform (GCP): Implement data solutions using GCP services like BigQuery, Dataflow, Dataproc, and Cloud Storage.
  • Programming and Scripting Languages:
  • Python: Direct data processing and ETL scripting initiatives using Python.
  • Java/Scala: Apply expertise in Java/Scala within big data frameworks such as Spark.
  • SQL: Utilize SQL for efficient querying and database manipulation.
  • Shell Scripting: Automate and orchestrate processes using shell scripting.
  • Data Warehousing:
  • Design and Optimization: Lead the design, implementation, and optimization of data warehousing solutions.
  • Tools: Utilize data warehousing tools such as Amazon Redshift, Snowflake, and Google BigQuery.
  • Data Governance and Security:
  • Data Quality: Ensure the accuracy and reliability of data across the organization.
  • Data Privacy and Security: Implement best practices for data protection and comply with data protection regulations.
  • Data Visualization and BI Tools:
  • Tools: Leverage visualization and BI tools like Tableau, Power BI, and Looker.
  • Dashboards and Reporting: Create and manage effective dashboards and reports for data-driven decision-making.
  • DevOps and CI/CD:
  • Automation: Implement CI/CD pipelines and tools such as Jenkins, GitLab CI, and CircleCI for continuous integration and deployment.
  • Infrastructure as Code (IaC): Utilize tools like Terraform, Ansible, or CloudFormation for infrastructure automation.
  • Machine Learning and AI:
  • Basic Understanding: Integrate machine learning models into data pipelines.
  • ML Platforms: Use ML platforms such as TensorFlow, PyTorch, or cloud-based ML services.
  • Project Management and Collaboration Tools:
  • Agile/Scrum: Apply agile methodologies for efficient project management.
  • Tools: Use project management and collaboration tools like JIRA, Confluence, and Trello.

    • Who should apply for this role?

  • 12+ years of experience within the field of data engineering.
  • Excellent understanding of data technologies landscape.
  • Well versed with pros and cons of various database technologies like Relational, NO SQL, MPP, Columnar databases.
  • Bachelor’s or Master’s degree in computer science, Engineering, or a related field.
  • Proven experience in data engineering, with at least 5 years in a leadership role.
  • Strong technical expertise across the outlined areas.
  • Excellent problem-solving skills and a strategic mindset.
  • Ability to understand a problem statement and implement analytical solutions & techniques independently or with minimal supervision
  • Ability to extract, aggregate and manage large volume data sets using data mining techniques
  • Experience with big data platforms and tools (eg. Hadoop, HDFS, Hive, Pig, Cassandra, Storm) is preferred but not mandatory
  • An excellent problem solver with get it done attitude
  • Ability to manage stakeholders and mentor junior team members


    • Viacom18 Media Pvt. Ltd. is one of India’s fastest-growing entertainment networks and a house of iconic brands that offers multi-platform, multi-generational, and multicultural brand experiences. Viacom18 defines entertainment in India by touching the lives of people through its properties on air, online, on the ground, in cinemas, and merchandise. Its portfolio of 38 channels across general entertainment, movies, sports, youth, music, and kids genres delights consumers across the country with its eclectic mix of programming. JioCinema, Viacom18’s OTT platform, is one of India’s leading streaming services and most popular destination for live sports. Viacom18 Studios has successfully produced and distributed iconic Hindi films and clutter-breaking regional films for over 13 years in India.

    We are an equal opportunity employer and all qualified applicants will be considered for employment without regard to race, color, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, disability status.

    Job role

    Work location
    Work locationBengaluru Bengaluru
    Department
    DepartmentData Science & Analytics
    Role / Category
    Role / CategoryData Science & Machine Learning
    Employment type
    Employment typeFull Time
    Shift
    ShiftDay Shift

    Job requirements

    Experience
    ExperienceMin. 12 years

    About company

    Name
    NameCorporate Forex
    Job posted by Corporate Forex

    Similar jobs you can apply for

    Software / Web Developer

    Software engineer PPJ1

    Xyz Brand
    Abbigere, Bengaluru
    ₹10,000 - ₹12,000
    Work from Office
    Full Time
    Freshers only
    No English Required

    Software engineer PPJ1

    Xyz Brand
    Abbigere, Bengaluru
    ₹10,000 - ₹12,000
    Work from Office
    Full Time
    Freshers only
    No English Required
    Dummy Test 123

    Software Developer

    Dummy Test 123
    Kalyan Nagar, Bengaluru
    ₹15,000 - ₹30,000
    Work from Office
    Full Time
    Min. 3 years
    Basic English

    Software engineer PPJ1

    Xyz Brand
    Abbigere, Bengaluru
    ₹10,000 - ₹12,000
    Work from Office
    Full Time
    Freshers only
    No English Required

    Website Developer

    test SMB
    Bengaluru
    ₹25,000 - ₹30,000*
    Work from Office
    Full Time
    Min. 5 years
    Good (Intermediate / Advanced) English

    Software engineer PPJ1

    Xyz Brand
    Abbigere, Bengaluru
    ₹10,000 - ₹12,000
    Work from Office
    Full Time
    Freshers only
    No English Required

    You can expect a minimum salary of 0 INR. The salary offered will depend on your skills, experience and performance in the interview.

    The candidate should have completed the required education and people who have 12 to 31 years are eligible to apply for this job. You can apply for more jobs in Bengaluru to get hired quickly.

    The candidate should have sound communication skills and sound communication skills for this job.

    Both Male and Female candidates can apply for this job.

    No, it's not a work from home job and can't be done online. You can explore and apply for other work from home jobs in Bengaluru at apna.

    No work-related deposit needs to be made during your employment with the company.

    Go to the apna app and apply for this job. Click on the apply button and call HR directly to schedule your interview.

    The last date to apply for this job is . For more details, download apna app and find Full Time jobs in Bengaluru . Through apna, you can find jobs in 64 cities across India. Join NOW!