portal resources jobs companies l lorven technologies, inc. hadoop admin

Hadoop Admin


Job Tilte: Hadoop Admin Location: Remote Duration: 12+ Months Job Description:
  • We are looking for 2-3 resources with Advanced Hadoop Admin skills with AWS .
  • The candidates also should have prior database administration experience and exposure to Snowflake and Talend.
  • Implementing, managing and administering the overall hadoop infrastructure.
  • Takes care of the day-to-day running of Hadoop clusters.
  • A hadoop administrator will have to work closely with the database team, network team, BI team and application teams to make sure that all the big data applications are highly available and performing as expected.
  • If working with open source Apache Distribution then hadoop admins have to manually setup all the configurations- Core-Site, HDFS-Site, YARN-Site and Map Red-Site.
  • However, when working with hadoop distribution like Cloudera the configuration files are setup on startup and the hadoop admin need not configure them manually.
  • Hadoop admin is responsible for capacity planning and estimating the requirements for lowering or increasing the capacity of the hadoop cluster.
  • Hadoop admin is also responsible for deciding the size of the hadoop cluster based on the data to be stored in HDFS.
  • Ensure that the hadoop cluster is up and running all the time.
  • Monitoring the cluster connectivity and performance.
  • Manage and review Hadoop log files.
  • Backup and recovery tasks
  • Resource and security management
  • Troubleshooting application errors and ensuring that they do not occur again.
  • Assisting users on connectivity for various tools like tableau, alteryx, talend and powerbi.
  • CDSW upgrade, administration and monitoring
  • KAFKA upgrade, administration and monitoring - is managed by data scientists as of now
- provided by Dice



Other openings you might be interested in

Sr. Hadoop Admin

Sr. Hadoop Admin

100% REMOTE- Sr. Hadoop Admin (only on W2; Long term Contract to Hire) Top Must-Have Skills: * Entire environment is Linux - must have experience and knowledge with Linux * Extensive DBA experience on multiple database technologies; Oracle exper

today
Systems Admin Specialist

Systems Admin Specialist

About CRS Catholic Relief Services is the official international humanitarian agency of the Catholic community in the United States. CRS works to save, protect, and transform lives in need in more than 100 countries, without regard to race, religion

this week
Admin Assistant - Site Offer Maintenance

Admin Assistant - Site Offer Maintenance

Site and Offer administrative responsibilities: * Handling new brand/merchant proposals and requests from local businesses to be added to our site * Logging into marketing affiliate portals to update their offer links on our site * Proactively re

today
More remote jobs

Other jobs at Lorven Technologies, Inc.

One job in the last 60 days · 1 in total · avg 12.11 jobs/mo · 50 job visits

Hadoop Admin

Hadoop Admin

JOB TILTE: HADOOP ADMIN LOCATION: REMOTE DURATION: 12+ MONTHS JOB DESCRIPTION: * We are looking for 2-3 resources with Advanced Hadoop Admin skills with AWS . * The candidates also should have prior database administration experience and expos

this week
Lorven Technologies, Inc.