Job Description

This Databricks subject matter expert will be coming in to assist a senior data engineering team to evaluate and assess their current usage of Databricks at an enterprise-level. They will consult on areas like: code best practices, performance tuning, cluster configurations, visualization and reporting as well as table and schema design to make recommendations. This person will collaborate with the team to implement these recommendations. This is an opportunity to work across multiple cloud providers with cutting edge technology and have an impact across an entire corporation.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com .

To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .

Skills and Requirements

• 5+ years of experience in data engineering.

    * Proficiency in SQL, Python,

    * High quality SQL writing experience

    * Python or PySpark for coding

    * Experience with using Scala

    * Experience with big data tools (e.g., Spark, Hadoop).

    * AWS or Azure familiarity

    * Advanced Databricks understanding - coding best practices, cluster configuration, visualization and reporting, table and schema design (Delta Tables, Unity Catalog)

    -Experience assessing, recommending, implementing best/optimal practices within Databricks

    * Familiarity with data modeling and database design.

    * Strong problem-solving skills and attention to detail. * Master's degree in a relevant field.

    * Certifications in cloud platforms (e.g., AWS Certified Data Analytics, Google Professional Data Engineer).

    * Knowledge of machine learning frameworks (e.g., TensorFlow, PyTorch). null

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.