Big Data Developer 2017-09-22T16:25:55+00:00

Big Data Developer


Adastra provides world-class Big Data, Business Intelligence, Data Integration, Data Quality, Data Warehousing, Data Governance, and Master Data Management services and solutions to companies around the globe and across industries. For twenty years, Adastra has been helping business and technology work together to protect existing data investments and unlock their business value using the most advanced tools, technologies, and methodologies available. Intelligent solutions for superior performance.

Job Duties and Responsibilities
  • Analyze, design, develop, test, document and troubleshoot Big Data programs from detailed and high level specifications

  • Utilize HDFS, HIVE / Impala, Sqoop, Spark, Falcon, Atlas, Ambari, Ranger, Sentry, Python, Scala and other ETL tools optimized for Big Data (Talend, Informatica BDE, Ataccama) to source , ingest, manipulate, load and analyze data.

  • Assist in the requirements analysis and subsequent developments

  • Conduct unit tests and assist in test preparations to ensure data integrity, data quality and program quality

  • Work closely with Designers, Business Analysts and other Developers

  • Liaise with Project Managers, Quality Assurance Analysts and Business Intelligence Consultants

  • Design and implement technical enhancements of Big Data, Data Warehouse, Business Intelligence solutions as required

Required Skills, Education, Knowledge and Experience
  • Robust experience with all aspects of Data Management processes, including acquisition, integration and consumption of structured and unstructured data

  • Cloudera Navigator/ Manager

  • 2-4 years of hands on experience providing technical solutions with utilizing Big Data tools are mandatory. This includes:  HDFS, HIVE / Impala, Sqoop, Spark, Falcon, Atlas, Ambari, Ranger, Sentry, Python, Scala and other ETL tools optimized for Big Data (Talend, Informatica BDE, Ataccama)

  • 2-4 years of experience working with tools used to integrate data including concepts such as joins, lookups, filters, transformations, de-normalization, and aggregations

  • 2-4 years of experience with Data Governance practices and techniques, including knowledge of Operational Metadata, Business Metadata, Technical Metadata (specifically with lineage) and Data Retention

  • Experience with utilizing tools used to ingest data of various forms including JSON, XML, Databases, REST APIs, Message Queue’s etc.

  • Familiarity with security considerations associated with data management such as encryption, masking, obfuscation and kerberos

  • Understanding of Data Architecture concepts and implementation techniques such as, normalization, denormalization, star and snowflake schemas

  • Experience with PL/SQL, SQL, Unix / Linux Shell Scripting (BASH, KSH) including development and troubleshooting used to automate and orchestrate tasks

  • Familiarity with algorithm design and implementation

  • Knowledge of object-oriented design and development

  • Experience with reporting tools to create prompt visualizations and reports to facilitate the consumption of data

  • Bachelor of Science Degree or higher education (Computer Science or related field is an asset)

  • Must be flexible to work throughout the Greater Toronto Area (GTA)

  • Strong communication and analytical skills

Desirable Skills and Experience
  • Experience in one or more of the following ETL tools optimized for Big Data, including Talend, Informatica BDE and Ataccama

  • Familiarity with partitioning approaches and strategies, as enables by certain tools, which can be used while data integration is an asset

  • Experience with Version Control M (GIT, Subversion etc.)

  • Experience with Python or other scripting languages is an asset

  • Familiarity with abstract data types and data structures for implementation

  • Experience with Software Development Approaches and Techniques (Waterfall, Agile etc.)

  • Industry experience in one or more of the following sectors is an asset:  Financial Services, Telecommunications, Mining, Insurance, Health Care, or Retail

Equal Opportunity Employer

In our commitment to promote fair and equitable treatment of all employees and applicants, Adastra Corporation provides equal employment opportunities for all individuals regardless of age, sex, disability, race, ethnic origin, citizenship, creed, sexual orientation, marital status or any other ground as described in the Ontario Human Rights Code.  In addition, accommodation will be provided during the hiring process. Adastra Corporation’s implementation and support of employment initiatives, encourage diversified labour force participation and equal access to opportunities based on merit and performance.

How to Apply

If you are interested in applying for this opportunity please apply directly to