[Hiring] Application Development Principal @S Base Technologies

Role Description

The Application Development Principal will be responsible for collaborating with business and technical stakeholders to gather and understand requirements, designing scalable data solutions, and developing production-grade ETL pipelines.

• Collaborate with business and technical stakeholders to gather and understand requirements.
• Design scalable data solutions and document technical designs.
• Develop production-grade, high-performance ETL pipelines using Spark and PySpark.
• Perform data modeling to support business requirements.
• Write optimized SQL queries using Teradata SQL, Hive SQL, and Spark SQL across platforms such as Teradata and Databricks Unity Catalog.
• Implement CI/CD pipelines to deploy code artifacts to platforms like AWS and Databricks.
• Orchestrate Databricks jobs using Databricks Workflows.
• Monitor production jobs, troubleshoot issues, and implement effective solutions.
• Actively participate in Agile ceremonies including sprint planning, grooming, daily stand-ups, demos, and retrospectives.

Qualifications

• Strong hands-on experience with Spark, PySpark, Shell scripting, Teradata, and Databricks.
• Proficiency in writing complex and efficient SQL queries and stored procedures.
• Solid experience with Databricks for data lake/data warehouse implementations.
• Familiarity with Agile methodologies and DevOps tools such as Git, Jenkins, and Artifactory.
• Experience with Unix/Linux shell scripting (KSH) and basic Unix server administration.
• Knowledge of job scheduling tools like CA7 Enterprise Scheduler.
• Hands-on experience with AWS services including S3, EC2, SNS, SQS, Lambda, ECS, Glue, IAM, and CloudWatch.
• Expertise in Databricks components such as Delta Lake, Notebooks, Pipelines, cluster management, and cloud integration (Azure/AWS).
• Proficiency with collaboration tools like Jira and Confluence.
• Demonstrated creativity, foresight, and sound judgment in planning and delivering technical solutions.

Requirements

• Spark
• Pyspark
• Shell Scripting
• Teradata
• Databricks

Additional Skills

• AWS SQS
• Foresight
• Sound Judgment
• SQL
• Stored Procedures
• Databricks For Data Lake/Data Warehouse Implementations
• Agile Methodologies
• GIT
• Jenkins
• Artifactory
• Unix/Linux Shell Scripting
• Unix Server Administration
• CA7 Enterprise Scheduler
• AWS S3
• AWS EC2
• AWS SNS
• AWS Lambda
• AWS ECS
• AWS Glue
• AWS IAM
• AWS CloudWatch
• Databricks Delta Lake
• Databricks Notebooks
• Databricks Pipelines
• Databricks Cluster Management
• Databricks Cloud Integration (Azure/AWS)
• JIRA
• Confluence
• Creativity