This site uses cookies. To find out more, see our Cookies Policy

Senior Big Data Developer in Houston, TX at Search Services

Date Posted: 11/14/2018

Job Snapshot

Job Description

The Senior Big Data Developer (Full Stack) will be responsible for design, development and testing of software solutions using Java, HBase, Spark, Scala and Kudu. This role requires experience in building new data pipelines and data ingestion applications to bring large volumes of transactional and unstructured data into data lakes. The ideal candidate should have good analytical skills, Hadoop and Java based application development. The ideal candidate should also possess good communication and interpersonal skills, attention to detail, a high level of motivation / work ethic and a proven track record in designing and developing big data applications.

This role performs under general direction of the Director.

Responsibilities:

  • Design and development of Java and Hadoop based applications using object oriented design practices and standard frameworks such as MVC, MVVM
  • Develop API’s and data ingestion pipelines to process structured and unstructured data
  • Develop migration strategies to move SQL databases to the big data platform and support business stakeholders with relational queries
  • Ensure quality and timely response to business requests for data and reporting
  • Monitor and validate real time data, identify drilling trends, irregularities or deviations and present findings, develop process improvements that improve data quality, drive efficiency, mitigate risk, or provide value to the organization
  • Lead, mentor and train other developers on developing big data solutions
  • Ability to interact with multiple levels within an organization

Requirements:

  • Hands-on development experience using open source and big technology stack – HBase, Spark, Kudu, Java, Hive and others to build complex data solutions. Experience working through the full product cycle from initial design to final product delivery
  • Proficient in data lake architecture, data pipe-lining and ingestion practices, database design, data warehousing, complex querying and optimization
  • Proven experience working with complex data structures and performance tuning activities
  • Proven abilities working within large, complex projects focused on end-to-end business flows thru multiple systems
  • Ability to work with 3rd party software and develop code/APIs to be embedded or integrated into other applications or frameworks
  • Ability to build, package and deploy the applications using continuous integration, with automated unit tests
  • Experience in working with WCF and REST based Web Services
  • Strong communication and presentation skills and proven track record in supporting multiple business units and management at all levels
  • Comfortable delivering presentations to a wide range of audiences including employees, managers and external customers
  • Ability to travel to regional locations and customer offices as required
  • Excellent verbal and written communication skills

Minimum Qualifications:

  • Bachelor’s Degree in Information Technology, Computer Science, Data Analytics, or related field
  • Java/J2EE – 5 years, Spark, Scala, Kudu, HBase – 3 years
  • Hadoop/Hive/Pig/MapReduce – 2 years
  • SQL and NoSQL Databases – 3 years

Preferred Qualifications:

  • Web development experience using responsive design with HTML5, AngularJS or Kendo frameworks
  • Experience building Business Intelligence Analytics and Visualizations using Tableau, SpotFire, Microsoft Power BI or other technology
  • Experience in Oil & Gas / drilling industry
  • Experience in AWS/Microsoft Azure and Cloud ready applications

Job Requirements

Hadoop and Java