This site uses cookies. To find out more, see our Cookies Policy

Career Search

Hadoop (Cloudera) Administrator in Baltimore, MD at M&T Bank

Date Posted: 11/19/2018

Job Snapshot

  • Employee Type:
    Full-Time
  • Location:
    Baltimore, MD
  • Job Type:
  • Experience:
    Not Specified
  • Date Posted:
    11/19/2018
  • Job ID:
    3DJW3

Job Description

Hadoop (Cloudera) Administrator

Baltimore, MD

Function:
Provides designs, specifies information systems solutions and the highest level technical direction in the development of new or existing applications to solve basic to complex problems or enhancements. Acts as a principal application designer for critical components and major modifications effectively using analytical skills, technical skills, available technology and tools in the evaluation of client requirements and processes. Provides solutions that are technologically sound. Often directs and monitors the activities of junior staff.

Responsibilities:
Responsible for Capacity Planning, Infrastructure Planning based on the workloads and future requirements

  • Interact with the business users, Enterprise Architects and Project Managers to gather the requirements.
  • Install Cloudera-Hadoop from scratch for different environments (Dev, Test, Cert, Production, Disaster Recovery).
  • Install and configure Kafka to facilitate real-time streaming applications.
  • Provide support and maintenance and its eco-systems include HDFS, Yarn, Hive, Impala, Spark, Kafka, HBase, Informatica BDB, and Tableau.
  • Work on issues and provide EBF’s (emergency bug fixes) for Informatica to meet the SLA. •Work with delivery teams for Provisioning of users into Hadoop.
  • Implement Hadoop Security like Kerberos, Cloudera Key Trustee Server and Key Trustee Management Systems.
  • Enable Sentry for RBAC (role-based access control) to have a privilege level access to the data in HDFS as per the security policies.
  • Enable data encryption at rest and at motion with TLS/SSL to meet the security standards.
  • Perform upgrades to Cloudera Manager, CDH along with support for Linux Server Patching from RHEL 7.1 to 7.4 (maipo).
  • Install of Informatica Big-Data-Management edition from scratch at development, Test, Certification and Production environments.
  • Perform upgrades to Informatica BDM from time to time as needed.
  • Establish of connections between Hadoop and Informatica BDM to perform Dynamic Mappings and Hive updates.
  • Enable Informatica as a data ingestion tool for Hadoop by creating and testing the connections from different databases like Mysql, Microsoft Sql, Oracle, Hive, Hdfs, Teradata.
  • Design and Implementation of Backup and Disaster Recovery strategy based out of Cloudera BDR utility for Batch applications and Kafka mirror maker for real-time streaming applications.
  • Enable the consumers to use the Data in Hive Tables from Tableau desktop as part of the requirement.
  • Establish the connection between Teradata Studio Express and Impala, so as to enable the consumer group for an easy migration to Hadoop query engines.
  • Integrate CA-7 enterprise scheduler to run the Jobs in both Hadoop/Informatica.
  • Align with development and architecture teams to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments. •Perform Capacity Planning of Informatica Big Data Management along with implementation design for grid execution.
  • Optimize and Performance tuning of the cluster by changing the parameters based on the benchmarking results such as Teragen/Terasort.
  • Implement GIT version control basing out of NFS shared drive for Hadoop and also integrate it to the Eclipse IDE.
  • Enable Sub-Version (svn) as version control
  • Enable connectivty of Tableau and SAS Grid to Hadoop


Required Qualifications:
Associate’s degree and a minimum of 6 years’ systems analysis/application development experience, or in lieu of a degree, a combined minimum of 8 years’ higher education and/or work experience, including a minimum of 6 years’ systems analysis/application development experience

Cloudrea Hadoop(CDH), Cloudera Manager, Informatica Bigdata Edition(BDM), HDFS, Yarn, MapReduce, Hive, Impala, KUDU, Sqoop, Spark, Kafka, HBase, Teradata Studio Express, Teradata, Tableau, Kerberos, Active Directory, Sentry, TLS/SSL, Linux/RHEL, Unix Windows, SBT, Maven, Jenkins, Oracle, MS SQL Server, Shell Scripting, Eclipse IDE, Git, SVN


Must have strong problem-solving and analytical skills
Must have the ability to identify complex problems and review related information to develop and evaluate options and implement solutions.


Proficiency with personal computers as well as pertinent software packages
Capable of working on multiple projects of a complex nature
Prior experience effectively using project management, word processing and spreadsheet applications
Excellent problem-solving skills to assist in issue resolution
Familiar with application development software and hardware platforms
Excellent verbal and written communication skills
Excellent organizational and time management skills
Strong lateral thinking skills
Strong presentation skills
Prior experience coordinating between Applications and business units
Prior experience driving project milestones and delivery dates
Prior experience recommending and implementing system solutions
Detail-oriented
Proven mentoring and leadership capabilities from a project management perspective

Preferred Qualifications:
Subject matter expert in business with knowledge or experience utilizing application/system being supported
Mastered understanding of applications supported with an advanced knowledge of interfacing/integrated applications
Understanding of the Bank’s application framework
Ability to work in a team environment as well as autonomously
Ability to multitask for various components of complex projects
Mastered knowledge and focus of the entire system to work on projects outside of normal business-as-usual (BAU)
Ability to understand businesses supported and its’ terminology

About M&T

At M&T, we understand what's important when you're considering a career change: a company with a solid history of responsible growth and positive earnings. A company committed to the communities it serves, one that rewards performance and provides employees with opportunities to direct their own career paths. M&T is a company with a focus on the future.

M&T Bank Corporation is an Equal Opportunity/Affirmative Action Employer. M&T Bank Corporation does not sponsor individuals for the purpose of obtaining H-1 Visas. M&T Bank Corporation has policies and procedures in place to promote a drug free workplace.