Big Data Engineer

Big Data Engineer Required Experience: 6+ years of Industry Experience with key engagements including Integration Architecture, Solution, Design & end-to-end implementation Responsibilities: • Define the Integration architecture landscape, including technology, information, data, security, and integration • Implement large-scale, innovative IT solutions to drive business transformation. • Define and deliver the Integration Technology aspects of the projects, including the timely production of architectural designs and documentation • Being a key contributor to architect & design Microservice, API Management, process automations & frameworks in project • Working with customers’ business and the Architecture team on large integration transformation programs that include multiple technology streams and complex architecture • Propose, Architecture, design and guide building reusable components, Able to drive the Architecture discussions with the end-customer • Communicating the implementation approach and design methodology to the offshore development team • Participating in a Technical Design Authority to assess and quantify the risks associated with design decisions and communicate these to the relevant parties • Develop technology strategy and planning deliverables to address IT risks and improve the effectiveness of the IT organization, especially in business application integration. • Produce target-state solution architecture, and perform assessments and gap analysis. • Help formulate the overall solution strategy. Must Have Skills :- (a) Databricks, Pyspark, Medallion Arch, CTE Queries (b) Python, ADL, ADF, Azure Cloud Storage & Container Exp (c) SQL, Stored Procedures, Views, User Defined Functions (d) SQL Server (e) Data Analysis Exp Nice To Have :- (a) Collibra (b) Alteryx work flow