DriversRecommendedOutdated drivers can make a good PC feel brokenScan driver issues before chasing fixes manually.Scan NowHalloween DealsAmazon USHalloween week deals: useful picks before month-endAmazon US: current deals, useful picks and tech finds.Check DealsSlow PC?RecommendedPC slow today? Run a repair scan before it gets worseResolve common Windows issues and optimize system performance.Scan Now×
Skip to content
VGSources
Blog

How to Install Hadoop in Standalone Mode on a Linux VPS

Install and verify Hadoop’s single-process standalone mode on a GNU/Linux VPS, then understand exactly when HDFS and pseudo-distributed configuration are necessary.
WorldStandalone Mode on a Linux VPS Length8 min Posted Quest giverVGSources Team
Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Install a Java-enabled Hadoop distribution on your GNU/Linux VPS, set JAVA_HOME, and run Hadoop’s MapReduce example without configuring HDFS. Standalone mode is Hadoop’s default non-distributed configuration: one Java process reads and writes through the local filesystem, which makes it a practical installation check and debugging environment. If you need HDFS or separately managed NameNode and DataNode processes, use pseudo-distributed mode instead.

What standalone Hadoop mode does

Standalone mode runs Hadoop as a single Java process with the default, non-distributed configuration. It does not create a cluster, start HDFS daemons, or provide a multi-process NameNode/DataNode deployment. Input and output are handled through the VPS filesystem while Hadoop executes the MapReduce job in one process.

As an Amazon Associate I earn from qualifying purchases.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Apache describes the purpose directly: “By default, Hadoop is configured to run in a non-distributed mode, as a single Java process. This is useful for debugging.” That makes standalone mode suitable for verifying Java, the Hadoop scripts, the distribution archive, and a basic MapReduce workload before adding HDFS configuration.

It is not a production-secure Hadoop cluster. Production deployments need controls such as Kerberos and secure access to HDFS and computation services.

#1 Best Overall
Sale
Gaoye Blue Light Blocking Glasses
  • BLUE LIGHT BLOCKING GLASSES: Our blue light glasses for women boast UV400 protection, blocking harmful blue rays from computer screens. With these bluelight glasses women, you can enjoy gaming, reading, or watching TV with no worries of eye strain.
  • EYE RELIEF: Our blue light glasses are engineered to reduce blurry vision or strain caused by prolonged screen time. These womens blue light glasses aid in better sleep by preventing blue light from disrupting your natural sleep cycle, helping you fall asleep faster and enjoy a more restful night's sleep, making them the perfect christmas present.
  • COMFORTABLE: Crafted from durable material, our trendy blue light glasses for woman or blue light glasses men ensure long-lasting comfort. The high-transmittance lenses accessories, gamer gifts for men, help keep your eyes relaxed. Perfect stocking stuffers, gifts for gamers men, christmas gifts for men, halloween costumes.
  • LIGHTWEIGHT: These clear blue light glasses feature a lightweight frame, meaning they’ll stay comfy for long-term wear. Perfect as blue blockers glasses for women or mens blue light glasses, these non-prescription fake glasses for men can be worn throughout the day. The blue light blocking glasses women feature polycarbonate HD lenses, which are anti-reflective and restore true color.
  • WORRY-FREE PURCHASE: If you experience any issues, our support team is ready to assist you quickly. These are the perfect costume glasses for cosplay dressing up.

Prerequisites on the Linux VPS

GNU/Linux and a usable account

Hadoop supports GNU/Linux. Use an account that can install packages and write to the directory where you will unpack Hadoop. Keep the Hadoop directory and test data on a filesystem with enough free space for the archive, the copied XML files, and the generated output.

There is no universal CPU, memory, disk, or network requirement in the single-node quick-start material. Select VPS capacity for the size of the files and jobs you intend to test rather than treating a standalone check as a benchmark.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Java

Java is required. Install a Java runtime or JDK supplied by your Linux distribution, then confirm that the shell can find it:

java -version

The command should print a version instead of a “command not found” error. Hadoop also needs the Java home directory, not merely the executable on your PATH. Before running Hadoop, edit etc/hadoop/hadoop-env.sh in the unpacked distribution and add or update the export for the actual Java installation directory:

export JAVA_HOME=/usr/java/latest

/usr/java/latest is Apache’s example path; replace it with the absolute Java home path that exists on your VPS. Do this before invoking bin/hadoop or submitting a job.

SSH and sshd

A one-process standalone example does not need SSH. Install and run an SSH server if you will use Hadoop scripts that manage daemons, or if you plan to move on to pseudo-distributed mode. On Ubuntu, Apache’s example installs the SSH package with:

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
sudo apt-get install ssh

Verify that sshd is running and that the VPS can make a loopback connection. Passwordless SSH to localhost is required by the pseudo-distributed startup scripts, not by the basic standalone MapReduce command. Apache also recommends pdsh for resource management in the single-node setup; it is optional for the standalone validation job.

Rank #2
Windex Gaming Cleaning Wipes, Pre-Moistened Wipes to Instantly Clean all Gaming Gear and Electronics, Resealable Packaging for a Freshness Lock, 25 count (Pack of 1)
  • WINDEX GAMING WIPES: effortlessly clean all your gaming gear and gaming electronics in one easy step with our new Windex Gaming Wipes
  • AMMONIA FREE: our ammonia-free formula is safe to use on all of your favorite gaming equipment like consoles, headsets, controllers, screens, keyboards, and more
  • PRE-MOISTENED WIPES: each wipe instantly removes dust, dirt, and stubborn smudges and fingerprints leaving a streak-free shine
  • ANTI-STATIC: great for cleaning and wiping down your gaming gear and electronics leaving behind no visible residue
  • COMPACT RESEALABLE PACKAGE: store your pack of Windex Gaming Wipes anywhere in your home for whenever a quick and easy wipedown is needed

Download and unpack a stable Hadoop distribution

Obtain a recent stable Hadoop distribution from an Apache Download Mirror. Choose the binary distribution appropriate for your GNU/Linux VPS, download the archive, and unpack it in a directory you control. The archive name contains the release number, so use that same version when locating the examples JAR later.

A typical archive extraction command has this form:

tar -xzf hadoop-<version>.tar.gz

After extraction, change into the resulting Hadoop directory. The paths used below—etc/hadoop/hadoop-env.sh, bin/hadoop, share/hadoop/mapreduce, and sbin—are relative to that directory.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Install Hadoop in standalone mode

  1. Confirm Java before editing Hadoop

    Run java -version. If it fails, install a distribution-supported Java package and repeat the check. Do not continue until the command works for the same Linux account that will run Hadoop.

  2. Set JAVA_HOME

    Open etc/hadoop/hadoop-env.sh and set JAVA_HOME to the absolute home directory of the installed Java runtime or JDK. The value must point to the directory containing Java’s standard subdirectories, not to the java executable itself.

  3. Check the Hadoop command-line interface

    From the Hadoop distribution directory, run:

    bin/hadoop

    The command should print Hadoop script usage documentation. This confirms that the launcher is present and that its environment can be read. If the script reports that Java cannot be found, return to etc/hadoop/hadoop-env.sh and correct JAVA_HOME.

  4. Create a local test input directory

    Make a directory and copy Hadoop’s XML configuration examples into it:

    Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
    Rank #3
    Sale
    LISEN Cell Phone Stand Phone Holder for Desk, Office Decor Gadgets for Men
    • Ergonomic & Adjustable Design: Fight "text neck" and improve your posture. Designed for comfort, it offers an adjustable height (7.1in-8.5in) (1.4in adjustable range) and angle (5°-85°) Please note: cell phone stand is only 9 inches tall—the length of a standard pencil
    • Without blocking subtitles Perfect for office desk Tiktok Face Time Zoom video—this is the ultimate kitchen desk essential for phones! Perfect viewing experience while reducing neck back strain, A must-have for gamers streamers desk, and anyone who values both style and support!
    • Sleek & Stable Design fits Otterbox Case: Say goodbye to bent cables, tangles, and tip-overs! LISEN’s stylish adjustable desk phone holder features a built-in charging hole and smart cable management, keeping your phone secure and your workspace clutter-free cool gadgets for men
    • ANTI-SLIP DESIGN free hands: The under 10.00 items easy gadgets back and the bottom of this kitchen essentials for women are fully covered by anti-skid silicone, which LISEN stand up desk decor can provide maximum protection device from any scratches and slides
    • Your Perfect Viewing Companion:If your product arrives damaged or breaks within 365 days, reach out to LISEN for a quick and hassle-free solution. Struggling with assembly, like tightening the screw? We’ve got your back! Your experience matters to us. (Product including: phone Holder stand*1, screw*1, hexagon screwdriver*1, specification*1)
    mkdir input
    cp etc/hadoop/*.xml input

    These files provide small, predictable text input for the example MapReduce job. The directory is ordinary local filesystem storage; no HDFS path is involved.

  5. Run the standalone MapReduce example

    Submit the bundled grep example:

    bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-3.5.0.jar grep input output 'dfs[a-z.]+'

    Change hadoop-mapreduce-examples-3.5.0.jar to the examples-JAR filename in the Hadoop version you actually unpacked. The command scans the XML files in input for text matching dfs[a-z.]+ and writes the result to a new local output directory.

  6. Read the result

    Display the generated files with:

    cat output/*

    A successful run creates output files containing the matching text and counts produced by the example. The exact lines depend on the XML files shipped with the selected Hadoop release. The important installation signals are that the Java process starts, the example completes without a launcher error, and files appear under output.

Understanding the validation job

The command tests several layers at once: the Hadoop distribution is unpacked correctly, the shell launcher can locate Java through JAVA_HOME, the MapReduce examples JAR is available, and standalone execution can read local input and write local output. It does not test NameNode operation, DataNode storage, HDFS permissions, replication, or network communication between daemons.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

The output directory must not already exist when the example starts. MapReduce generally refuses to overwrite an existing output path. If you rerun the test, remove the prior result first:

rm -rf output

Keep the input directory, but recreate it if you want to change the files being scanned. Do not remove a directory unless you are certain it contains only this test’s output.

Standalone versus pseudo-distributed mode

Both modes can run on one VPS, but they answer different questions.

Rank #4
Ledagic IC+RGBW USB Powered Led Light Bar with App & Remote Control, 2 Pack
  • Easy Installation: Our gaming lights have been designed to enhance your entertainment experience. Simply position the led light bar next to your TV or game console to create a game room environment with ease. They come with USB power and a 60 inch cord for direct mounting and mobility
  • Audio Syncing & Extensive Mode: The built-in high-sensitivity music sensor allows you to sync the TV led lights to your favorite music. Lights react and move to the beat of music, film and game audio, creating an incredible immersive sound and light experience – and all without the need for an additional hub. You can choose from 64+ patterns, including strobe, illusion, jump, energy, gradient, running, chasing, fluttering mode etc. Each mode can be applied to different scenes
  • 64+ Chasing IC+RGB & W Effect: The independent control design of IC+RGB and white all-in-one multifunctional rgbw led bar lights monitor backlight allows you to easily switch the led lights for desk between IC+RGB and white to enjoy a variety of lighting effects, you can choose white lighting mode with high brightness for better illumination when working, etc. Choose IC+RGB lighting mode when you need to create an entertaining atmosphere for the light show, 16 million colours of Color changing rgb light bar let you dance to the beat and create a dynamic party atmosphere
  • Dynamic and Dimmable Lights: 1%-full brightness free brightness adjustment gives you the flexibility to adjust dimmable led light bar for room decorations or a variety of occasions
  • USB Powered: USB light bars for room can be powered by powernank, usb charger, TV, Monitor, laptop PC mainframe, making behind TV led lighting bar easy to install in any location.TV led lights are powered by the TV usb interface / PC mainframe, can be turned on/off synchronously with TV / PC
Aspect Standalone Pseudo-distributed
Process model One Java process for the non-distributed job Separate Hadoop daemon processes on one VPS
Storage Local filesystem behavior; no HDFS service HDFS, with a NameNode and DataNode configuration
SSH Not needed for the one-process validation example Passwordless SSH to localhost is needed by daemon-management scripts
Best use Installation checks, debugging, and small MapReduce experiments Practicing single-node HDFS and multi-daemon MapReduce behavior
Replication setting Not applicable because the test does not use HDFS Apache’s single-node example sets dfs.replication to 1

Choose standalone when the goal is simply to run Hadoop code locally. Choose pseudo-distributed when your application or tutorial expects HDFS URIs, HDFS permissions, daemon logs, or separate service processes.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

When to switch to pseudo-distributed mode

Pseudo-distributed mode still uses one VPS, but it emulates a cluster by running Hadoop daemons separately. Apache’s single-node example configures the default filesystem as hdfs://localhost:9000 and sets HDFS replication to 1, appropriate for a one-machine practice environment rather than fault tolerance.

Configure the filesystem properties

Edit the Hadoop XML configuration files in etc/hadoop as required by the single-node guide. The essential values for this comparison are:

<property>
  <name>fs.defaultFS</name>
  <value>hdfs://localhost:9000</value>
</property>
<property>
  <name>dfs.replication</name>
  <value>1</value>
</property>

These settings change the target from local filesystem access to HDFS on the VPS. They do not turn the machine into a fault-tolerant cluster.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Prepare passwordless localhost SSH

Test the loopback connection first:

ssh localhost

If it asks for a password or cannot connect, create an SSH key for the Hadoop account and add its public key to that account’s authorized_keys file, then test ssh localhost again. The daemon scripts use this non-interactive connection to start and stop the local services.

Start and stop the HDFS daemons

Once the Java environment, XML properties, and localhost SSH are ready, use the Hadoop single-node startup procedure to launch HDFS. When finished, stop it with:

sbin/stop-dfs.sh

Do not use the pseudo-distributed daemon scripts as a substitute for the standalone validation. They introduce HDFS state, service logs, SSH behavior, and filesystem permissions that the one-process test intentionally avoids.

Best Value
Sale
HUANUO FlowLift™ Dual Monitor Stand, Fully Adjustable Gaming Monitor Desk Mount for 13–32″ Computer Screens, Full Motion VESA 75x75/100x100 with C-Clamp & Grommet Base, Each Arm Holds 4.4 to 19.8 lbs
  • Compatible with Wide Screens - To ensure compatibility with the dual monitor mount, your each monitor must meet three conditions at the same time: First, computer screens size range: 13 to 32 inches. Second, screen weight range: 4.4 to 19.8 lbs. Third, the back of the monitor screen must have VESA mounting holes with a pitch of 75x75mm or 100x100mm.
  • Regarding the compatibility with desks - Your desk must meet three conditions at the same time: First, desk material: Only wooden desks are recommended, plastic or glass desks cannot be used. Second, desk thickness range: 0.59" - 3.54". Third, the bottom of the desk should not have any cross beams or panels, as this will interfere with installation. We recommend carefully checking that your desk and monitors meets all above conditions before purchasing.
  • Dual C-Clamp Hold - Worried your dual monitors might wobble or slip? Our upgraded base uses a larger platform plus a dual C-clamp structure to lock the dual monitor arm firmly to your desk. Each arm safely keeps your screens steady while you type, click and game—no shaking, no sliding, just a clean and secure setup you can trust every day. It also provides Grommet Mounting installation choice, both options ensure stable and secure fixation for your 0.59" - 3.54" desk.
  • Full-Motion Adjustment For Comfortable View - Pull the screen closer when you’re deep in a spreadsheet, push it back to watch videos, or rotate to portrait for coding — moving everything smoothly with just one hand. The monitor stand offers +85°/-50° tilt, ±90° swivel and 360° rotation. Raise your monitor up to 15.75″ to support a healthy sitting posture. Whether you’re working from home, gaming through the night, or switching between video calls and documents, getting the screens to your natural line of sight helps relieve neck, shoulder and back strain so you can stay focused longer with less fatigue.
  • Keep Your Desk Organized: By lifting both screens off the desktop, this dual monitor stand opens up valuable space for your keyboard, notebook, docking station or a simple, clutter-free work area. Built-in cable management guides wires along the arms, keeping cords out of sight and out of the way. Enjoy a tidy, modern workstation that looks as good as it feels to use.

Troubleshooting common failures

bin/hadoop says Java is missing

  • Run java -version as the Hadoop user.
  • Check that JAVA_HOME is set in etc/hadoop/hadoop-env.sh, not only in an interactive shell profile.
  • Use the Java home directory, rather than a path ending in /bin/java.
  • Re-run bin/hadoop from the unpacked distribution directory.

The examples JAR cannot be found

List the MapReduce directory and use the filename shipped with your archive:

Free tools Windows power users keep installed

One-click scans. No signup required.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
ls share/hadoop/mapreduce

The documented example uses the Hadoop 3.5.0 filename, but another stable release may include a different version suffix. Update only the JAR name in the command; keep the grep arguments consistent with the test you intend to run.

The job refuses to use the output directory

Standalone MapReduce will not overwrite an existing result path. Inspect the directory, preserve anything valuable, and remove only this test’s output before retrying:

rm -rf output

ssh localhost fails in pseudo-distributed mode

  • Confirm that the SSH package is installed and sshd is running.
  • Test the exact Linux account that will run the Hadoop scripts.
  • Ensure that the account’s public key is present in its authorized_keys file.
  • Repeat ssh localhost until it completes without an interactive password prompt.

HDFS commands behave unexpectedly after a standalone test

Standalone mode does not create HDFS services or HDFS directories. Check that you are using the intended configuration and mode: local paths belong to the standalone example, while hdfs://localhost:9000 belongs to pseudo-distributed configuration. Do not infer HDFS health from a successful local MapReduce run.

Security and operational boundaries

A standalone Hadoop process on a VPS is a development and diagnostic environment. It does not provide the authentication, authorization, encryption, auditing, or service isolation expected of a production cluster. Avoid exposing Hadoop service ports to the public internet, and do not place sensitive data in a quick-start installation.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

For production use, follow Hadoop’s security guidance, including Kerberos and secure access to HDFS and computation services. Treat the standalone command as a functional smoke test, not as evidence that a VPS is ready to host production workloads.

Standalone installation checklist

  • GNU/Linux is available and the Hadoop account can install or access the required files.
  • Java is installed and java -version succeeds.
  • JAVA_HOME points to the actual Java home in etc/hadoop/hadoop-env.sh.
  • A stable Hadoop archive from an Apache Download Mirror is unpacked.
  • bin/hadoop prints its usage documentation.
  • The examples JAR filename matches the Hadoop release on the VPS.
  • The grep example creates readable files in output.
  • SSH is installed only when daemon scripts or pseudo-distributed mode require it, and ssh localhost works without an interactive password for that mode.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Leave a Reply

Your email address will not be published. Required fields are marked *

What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

More quests from Patch Notes

  1. How to Set Up a RedM (RDR2) Server in 2026: License Key, txAdmin and server.cfg, Step by StepBlog11min
  2. Best RedM (RDR2) Server Hosting in 2026: Comparing Four Hosts on Slots, Memory and PriceBlog10min
  3. How to Host a Mindustry Server in 2026: server-release.jar, Port 6567 and the Commands That MatterBlog7min
Recommended PC Tool
Recommended PC Tool
Outdated Drivers Are Slowing You DownFree scan - exact matches
PC Slower Than It Used to Be?Free scan - under a minute

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.