X-Received: by 2002:a05:6214:1634:: with SMTP id e20mr12372191qvw.205.1579720626033; Wed, 22 Jan 2020 11:17:06 -0800 (PST) X-Received: by 2002:a81:8785:: with SMTP id x127mr7911499ywf.455.1579720625786; Wed, 22 Jan 2020 11:17:05 -0800 (PST) Path: csiph.com!xmission!news.snarked.org!border2.nntp.dca1.giganews.com!border1.nntp.dca1.giganews.com!nntp.giganews.com!g89no204261qtd.0!news-out.google.com!w29ni21qtc.0!nntp.google.com!g89no204251qtd.0!postnews.google.com!google-groups.googlegroups.com!not-for-mail Newsgroups: comp.lang.java.programmer Date: Wed, 22 Jan 2020 11:17:05 -0800 (PST) Complaints-To: groups-abuse@google.com Injection-Info: google-groups.googlegroups.com; posting-host=182.76.128.2; posting-account=NpjiNAoAAAAg-gmByNdi7-GgVm2WGUeN NNTP-Posting-Host: 182.76.128.2 User-Agent: G2/1.0 MIME-Version: 1.0 Message-ID: <15627c9d-e895-4b37-a441-61d23fa2e982@googlegroups.com> Subject: data engineer From: sudipta basak Injection-Date: Wed, 22 Jan 2020 19:17:06 +0000 Content-Type: text/plain; charset="UTF-8" Lines: 46 Xref: csiph.com comp.lang.java.programmer:39281 Role: Data Engineer Location: Carlsbad, CA Duration: 6 months Description: Design, develop, test, deploy, support, enhance data integration solutions seamlessly to connect. Innovate for data integration in Apache Spark-based Platform to ensure the technology solutions leverage cutting edge integration capabilities. Facilitate requirements gathering and process mapping workshops, review business/functional requirement documents, author technical design documents, testing plans and scripts. Assist with implementing standard operating procedures, facilitate review sessions with functional owners and end-user representatives, and leverage technical knowledge and expertise to drive improvements. Primary Skills: 4+ years working experience in data integration and pipeline development. BS degree in CS, CE or EE. 2+ years of Experience with AWS Cloud on data integration with Apache Spark, EMR, Glue, Kafka, Kinesis, and Lambda in S3, Redshift, RDS, MongoDB/DynamoDB ecosystems Strong real-life experience in python development especially in PySpark in AWS Cloud environment. Design, develop test, deploy, maintain and improve data integration pipeline. Experience in Python and common python libraries. Strong analytical experience with database in writing complex queries, query optimization, debugging, user defined functions, views, indexes etc. Strong experience with source control systems such as Git, Bitbucket, and Jenkins build and continuous integration tools. Databricks Experience is a plus. Feel free to reach out in case of any queries. Sudipto Basak ||Talent Acquisition Specialist|| E- Mail : sudipta@intellogroup.com Office-302-425-9628 Intello Group, Inc 500 Delaware Ave, Wilmington, DE 19899, USA Website : http://www.intellogroup.com