Big Data Lead

Project/Engagement Deliverables:          

To realize this vision, IT is establishing a Data & Analytics function underneath the Chief Technology Officer. This organization’s goal will be to drive technological innovation, ensure the alignment of technology strategies with business objectives, and enhance the firm's competitive edge.

The Data Engineer is responsible for designing, developing, and maintaining the infrastructure and systems required for data storage, processing, and analysis. They play a crucial role in building and managing the data pipelines that enable efficient and reliable data integration, transformation, and delivery for all data users across the enterprise. You will collaborate with various groups within the Technology organization and across the firm to deliver high-value technology solutions and achieve organizational success.

           Designs and develops data pipelines that extract data from various sources, transform it into the desired format, and load it into the appropriate data storage systems

           Collaborates with architects, data scientists, AI engineers, and analysts to manage data as an asset and optimize models and algorithms for data quality, security, and governance

           Integrates data from different sources, including databases, data warehouses, APIs, and external systems

           Ensures data consistency and integrity during the integration process, performing data validation and cleaning as needed

           Transforms raw data into a usable format by applying data cleansing, aggregation, filtering, and enrichment techniques

           Optimizes data pipelines and data processing workflows for performance, scalability, and efficiency

           Monitors and tunes data systems, identifies and resolves performance bottlenecks, and implements caching and indexing strategies to enhance query performance

           Implements data quality checks and validations within data pipelines to ensure the accuracy, consistency, and completeness of data

           Takes authority, responsibility, and accountability for exploiting the value of enterprise information assets and of the analytics used to render insights for decision making, automated decisions and augmentation of human performance 

Confirm Project/Engagement Deliverables      

           To realize this vision, IT is establishing a Data & Analytics function underneath the Chief Technology Officer. This organization’s goal will be to drive technological innovation, ensure the alignment of technology strategies with business objectives, and enhance the firm's competitive edge.

           The Data Engineer is responsible for designing, developing, and maintaining the infrastructure and systems required for data storage, processing, and analysis. They play a crucial role in building and managing the data pipelines that enable efficient and reliable data integration, transformation, and delivery for all data users across the enterprise. You will collaborate with various groups within the Technology organization and across the firm to deliver high-value technology solutions and achieve organizational success.

           Designs and develops data pipelines that extract data from various sources, transform it into the desired format, and load it into the appropriate data storage systems

           Collaborates with architects, data scientists, AI engineers, and analysts to manage data as an asset and optimize models and algorithms for data quality, security, and governance

           Integrates data from different sources, including databases, data warehouses, APIs, and external systems

           Ensures data consistency and integrity during the integration process, performing data validation and cleaning as needed

           Transforms raw data into a usable format by applying data cleansing, aggregation, filtering, and enrichment techniques

           Optimizes data pipelines and data processing workflows for performance, scalability, and efficiency

           Monitors and tunes data systems, identifies and resolves performance bottlenecks, and implements caching and indexing strategies to enhance query performance

           Implements data quality checks and validations within data pipelines to ensure the accuracy, consistency, and completeness of data

           Takes authority, responsibility, and accountability for exploiting the value of enterprise information assets and of the analytics used to render insights for decision making, automated decisions and augmentation of human performance 

Overall Scope or Job Description:       

• Communicate clearly and concisely with others, including senior leadership, in and outside of the organization in a credible, engaging, and confident manner. Possess the ability to adapt communication style and method as necessary, using the most effective communication method for each situation.
• Summarize and translate complex, technical information into straightforward language that is simple, memorable, and engaging for various technical and non-technical audiences, helping with interpretation based on anticipated use of the information.
• Ability to think critically and creatively. Demonstrate skill at using a variety of tools and processes to conduct research and analyses; Recognize trends in complex data and information; Use these insights to identify opportunities and make timely decisions, taking into consideration the short and long-term implications of decisions. Advise key decision makers and influence others using persuasion and negotiation tactics.
• Take the initiative to make things happen. Proactively look for solutions and help others to think ahead. Accept and seek challenges; Step outside of your comfort zone. Think and act strategically to drive the success of the business and enhance our client experience. Be innovative and share ideas for continuous improvement. Look for efficiencies in the way work is completed.
• Be flexible and work effectively across various types of situations to achieve goals. Navigate through unexpected issues and be responsive to others’ needs. Prioritize different work streams and balance short-term versus long-term objectives.
• Value individual differences and treat everyone with respect and kindness. Be appreciative of others; Strive for humility. Respect diverse backgrounds and ways of thinking. Listen to understand and express genuine interest in other perspectives. Strive to understand and take ownership of how your emotions and actions impact others.
• Align actions with words, and approach work and interactions with others with a positive attitude and an optimistic outlook. Assume positive intent. Stay composed and resilient during challenging times. Respond productively to conflict and have difficult conversations when needed.
• Distinguish yourself with stakeholders in and outside the firm by growing your personal brand. Look for ways to share knowledge, make an impact, and leverage talents.
• Certifications in relevant technologies listed above.
• Previous experience in the professional services or accounting industry.
• Previous client service or consultative experience.
• Previous experience working in a managed services provider environment.

Desirable Characteristics

Reporting Relationship 

Confirm Overall Scope  

• Communicate clearly and concisely with others, including senior leadership, in and outside of the organization in a credible, engaging, and confident manner. Possess the ability to adapt communication style and method as necessary, using the most effective communication method for each situation.
• Summarize and translate complex, technical information into straightforward language that is simple, memorable, and engaging for various technical and non-technical audiences, helping with interpretation based on anticipated use of the information.
• Ability to think critically and creatively. Demonstrate skill at using a variety of tools and processes to conduct research and analyses; Recognize trends in complex data and information; Use these insights to identify opportunities and make timely decisions, taking into consideration the short and long-term implications of decisions. Advise key decision makers and influence others using persuasion and negotiation tactics.
• Take the initiative to make things happen. Proactively look for solutions and help others to think ahead. Accept and seek challenges; Step outside of your comfort zone. Think and act strategically to drive the success of the business and enhance our client experience. Be innovative and share ideas for continuous improvement. Look for efficiencies in the way work is completed.
• Be flexible and work effectively across various types of situations to achieve goals. Navigate through unexpected issues and be responsive to others’ needs. Prioritize different work streams and balance short-term versus long-term objectives.
• Value individual differences and treat everyone with respect and kindness. Be appreciative of others; Strive for humility. Respect diverse backgrounds and ways of thinking. Listen to understand and express genuine interest in other perspectives. Strive to understand and take ownership of how your emotions and actions impact others.
• Align actions with words, and approach work and interactions with others with a positive attitude and an optimistic outlook. Assume positive intent. Stay composed and resilient during challenging times. Respond productively to conflict and have difficult conversations when needed.
• Distinguish yourself with stakeholders in and outside the firm by growing your personal brand. Look for ways to share knowledge, make an impact, and leverage talents.

Desirable Characteristics

• Certifications in relevant technologies listed above.
• Previous experience in the professional services or accounting industry.
• Previous client service or consultative experience.
• Previous experience working in a managed services provider environment.
• Reporting Relationship
• A bachelor’s degree in computer science, data science, software engineering, information systems, or related quantitative field;

• 8+ years of overall experience in data engineering – primarily within data including experience with data modelling, ETL/ELT, data integration, master data management/entity management, data quality, data warehousing, analytics (prescriptive, predictive), business intelligence, data science, and governance.
• Proficiency in programming languages such as C#, Python, SQL, and Java.
• Experience with Microsoft technologies (SQL Server (IaaS, PaaS), Synapse, CosmosDB, HDInsight, Azure Data Factory, Azure Databricks, Power BI, Fabric), Informatica cloud technologies (CIH, DIH, CDGC, Master Data Management, Data Quality), Snowflake, and other relevant industry leaders. 
• Please specify any qualifications necessary for this position:       A bachelor’s degree in computer science, data science, software engineering, information systems, or related quantitative field;
• 8+ years of overall experience in data engineering – primarily within data including experience with data modelling, ETL/ELT, data integration, master data management/entity management, data quality, data warehousing, analytics (prescriptive, predictive), business intelligence, data science, and governance.
• Proficiency in programming languages such as C#, Python, SQL, and Java.
• Experience with Microsoft technologies (SQL Server (IaaS, PaaS), Synapse, CosmosDB, HDInsight, Azure Data Factory, Azure Databricks, Power BI, Fabric), Informatica cloud technologies (CIH, DIH, CDGC, Master Data Management, Data Quality), Snowflake, and other relevant industry leaders.