Recommended Free Tools
To ask search engines not to index an entire WordPress site, open Settings > Reading, enable Discourage search engines from indexing this site, and click Save Changes. Current WordPress adds a noindex,nofollow robots directive to pages that use the normal wp_head hook. The site remains publicly reachable, however; this checkbox is a search-exclusion request, not a privacy or access-control system.
Antihost offers managed WordPress hosting with free migration, one-click staging and a 14-day free trial.
For one page, post, archive, or downloadable file, use a page-level noindex meta tag or an HTTP X-Robots-Tag header instead. Do not put noindex in robots.txt: Google does not support that rule, and blocking a crawler can prevent it from seeing a valid noindex directive.
As an Amazon Associate I earn from qualifying purchases.
What WordPress’s “Discourage” setting actually does
The setting is a site-wide signal for search crawlers. When it is enabled and the active theme calls wp_head, WordPress outputs this directive in the document head:
<meta name='robots' content='noindex,nofollow' />noindex asks a crawler not to include the URL in its search index. nofollow asks it not to follow links on that page. WordPress describes the option as a request that search engines must choose to honor. It does not hide the site from ordinary visitors, prevent someone from typing its address, or require a login.
#1 Best Overall
- BLUE LIGHT BLOCKING GLASSES: Our blue light glasses for women boast UV400 protection, blocking harmful blue rays from computer screens. With these bluelight glasses women, you can enjoy gaming, reading, or watching TV with no worries of eye strain.
- EYE RELIEF: Our blue light glasses are engineered to reduce blurry vision or strain caused by prolonged screen time. These womens blue light glasses aid in better sleep by preventing blue light from disrupting your natural sleep cycle, helping you fall asleep faster and enjoy a more restful night's sleep, making them the perfect christmas present.
- COMFORTABLE: Crafted from durable material, our trendy blue light glasses for woman or blue light glasses men ensure long-lasting comfort. The high-transmittance lenses accessories, gamer gifts for men, help keep your eyes relaxed. Perfect stocking stuffers, gifts for gamers men, christmas gifts for men, halloween costumes.
- LIGHTWEIGHT: These clear blue light glasses feature a lightweight frame, meaning they’ll stay comfy for long-term wear. Perfect as blue blockers glasses for women or mens blue light glasses, these non-prescription fake glasses for men can be worn throughout the day. The blue light blocking glasses women feature polycarbonate HD lenses, which are anti-reflective and restore true color.
- WORRY-FREE PURCHASE: If you experience any issues, our support team is ready to assist you quickly. These are the perfect costume glasses for cosplay dressing up.
The normal head hook matters. A custom theme, template, cache, or optimization layer that removes or replaces wp_head can prevent the expected tag from being rendered. The checkbox can therefore be on while the delivered HTML does not contain the directive; verification should always be based on the rendered response, not just the dashboard state.
Turn off indexing for the entire site
- Sign in to the WordPress administrator dashboard.
- Open Settings > Reading.
- Scroll to Search Engine Visibility.
- Enable Discourage search engines from indexing this site.
- Click Save Changes.
After saving, WordPress applies the setting to the site’s front-end output. Existing search results do not necessarily disappear immediately. A crawler must revisit the affected URLs, fetch the response, and process the directive. Search engines can also retain a result temporarily while they recrawl.
Outdated Drivers Are Slowing You Down
One free scan finds every outdated or missing driver and matches the right update for your exact hardware.Free scan · exact hardware matchPC Slower Than It Used to Be?
A free scan shows the junk files, broken settings and background clutter dragging Windows down - then fixes them in one click.Free scan · Windows 10 & 11Turn the setting off when the site is ready
For a public launch, return to Settings > Reading, clear the checkbox, and click Save Changes. Then inspect a representative page’s source and confirm that the site-wide noindex directive is gone. Purge any page, reverse-proxy, or hosting cache that could still be serving the old head content.
Site-wide noindex versus actual privacy
The WordPress checkbox controls discoverability in search; it does not control access. WordPress’s documentation states that neither the visibility option nor its companion setting blocks access to the site and that search engines must honor the request.
Rank #2
- WINDEX GAMING WIPES: effortlessly clean all your gaming gear and gaming electronics in one easy step with our new Windex Gaming Wipes
- AMMONIA FREE: our ammonia-free formula is safe to use on all of your favorite gaming equipment like consoles, headsets, controllers, screens, keyboards, and more
- PRE-MOISTENED WIPES: each wipe instantly removes dust, dirt, and stubborn smudges and fingerprints leaving a streak-free shine
- ANTI-STATIC: great for cleaning and wiping down your gaming gear and electronics leaving behind no visible residue
- COMPACT RESEALABLE PACKAGE: store your pack of Windex Gaming Wipes anywhere in your home for whenever a quick and easy wipedown is needed
| Goal | Correct control | Can a normal visitor request the URL? | What it proves |
|---|---|---|---|
| Discourage indexing of every public URL | WordPress Discourage search engines from indexing this site | Yes | The response asks crawlers not to index it |
| Keep selected URLs out of search | HTML noindex or HTTP X-Robots-Tag |
Yes, unless another control denies access | The selected resource carries a noindex instruction |
| Prevent access to pre-launch or confidential content | Login, password protection, or server/application authentication | No, without credentials | The server or application denies unauthorised requests |
| Manage which paths a crawler fetches | robots.txt crawl rules |
Usually yes | A crawl preference, not a guaranteed removal instruction |
If a draft, customer area, staging copy, or private document must not be reachable, put authentication at the application, hosting, or server layer. You can also use noindex as an additional search signal, but noindex alone is not a security boundary.
Hide only one WordPress page, post, or archive
For selective exclusion, leave the global checkbox off and add noindex to the specific URL or resource. Google supports two forms:
- An HTML robots meta tag in the page’s
<head>section. - An HTTP
X-Robots-Tagresponse header, useful for non-HTML resources such as PDFs and other files.
HTML meta directive
A minimal page-level example is:
<meta name='robots' content='noindex'>In WordPress, a reputable SEO plugin can expose a per-post or per-page “no index” control. Theme or custom code can also conditionally print the tag for a known post type, archive, or URL pattern. The implementation must place the tag in the response that the crawler receives; text displayed in the editor or a client-side script that runs after the initial response is not a substitute.
HTTP header directive
For a file or response that is not an HTML document, send:
Rank #3
- Ergonomic & Adjustable Design: Fight "text neck" and improve your posture. Designed for comfort, it offers an adjustable height (7.1in-8.5in) (1.4in adjustable range) and angle (5°-85°) Please note: cell phone stand is only 9 inches tall—the length of a standard pencil
- Without blocking subtitles Perfect for office desk Tiktok Face Time Zoom video—this is the ultimate kitchen desk essential for phones! Perfect viewing experience while reducing neck back strain, A must-have for gamers streamers desk, and anyone who values both style and support!
- Sleek & Stable Design fits Otterbox Case: Say goodbye to bent cables, tangles, and tip-overs! LISEN’s stylish adjustable desk phone holder features a built-in charging hole and smart cable management, keeping your phone secure and your workspace clutter-free cool gadgets for men
- ANTI-SLIP DESIGN free hands: The under 10.00 items easy gadgets back and the bottom of this kitchen essentials for women are fully covered by anti-skid silicone, which LISEN stand up desk decor can provide maximum protection device from any scratches and slides
- Your Perfect Viewing Companion:If your product arrives damaged or breaks within 365 days, reach out to LISEN for a quick and hassle-free solution. Struggling with assembly, like tightening the screw? We’ve got your back! Your experience matters to us. (Product including: phone Holder stand*1, screw*1, hexagon screwdriver*1, specification*1)
X-Robots-Tag: noindexThe header can be added by the web server, hosting configuration, application code, or a delivery layer that controls the response. Apply it to the exact resource pattern you intend to exclude and test the final response from the public URL.
Why the crawler must be able to fetch it
A crawler can read a meta tag or response header only after retrieving the URL. If robots.txt blocks the request first, the crawler may never see noindex. A URL discovered through links can therefore remain represented in search even though its content is not being crawled. For a URL that should leave the index, make it fetchable and return noindex rather than combining a crawl block with an unseen directive.
Free tools Windows power users keep installed
One-click scans. No signup required.
Why robots.txt is not a removal tool
robots.txt tells compliant crawlers which paths they should avoid fetching. It does not reliably erase a URL that is already known, and it does not provide authentication. A search engine may learn a blocked URL from links, sitemaps, or other references and continue to show a limited result without fetching the page.
Google explicitly says that specifying a noindex rule in robots.txt is not supported. Use a meta tag or X-Robots-Tag for indexing control. If a previous configuration added a blanket Disallow: /, remove that block when you need Google to fetch the response and observe noindex.
Rank #4
- Easy Installation: Our gaming lights have been designed to enhance your entertainment experience. Simply position the led light bar next to your TV or game console to create a game room environment with ease. They come with USB power and a 60 inch cord for direct mounting and mobility
- Audio Syncing & Extensive Mode: The built-in high-sensitivity music sensor allows you to sync the TV led lights to your favorite music. Lights react and move to the beat of music, film and game audio, creating an incredible immersive sound and light experience – and all without the need for an additional hub. You can choose from 64+ patterns, including strobe, illusion, jump, energy, gradient, running, chasing, fluttering mode etc. Each mode can be applied to different scenes
- 64+ Chasing IC+RGB & W Effect: The independent control design of IC+RGB and white all-in-one multifunctional rgbw led bar lights monitor backlight allows you to easily switch the led lights for desk between IC+RGB and white to enjoy a variety of lighting effects, you can choose white lighting mode with high brightness for better illumination when working, etc. Choose IC+RGB lighting mode when you need to create an entertaining atmosphere for the light show, 16 million colours of Color changing rgb light bar let you dance to the beat and create a dynamic party atmosphere
- Dynamic and Dimmable Lights: 1%-full brightness free brightness adjustment gives you the flexibility to adjust dimmable led light bar for room decorations or a variety of occasions
- USB Powered: USB light bars for room can be powered by powernank, usb charger, TV, Monitor, laptop PC mainframe, making behind TV led lighting bar easy to install in any location.TV led lights are powered by the TV usb interface / PC mainframe, can be turned on/off synchronously with TV / PC
WordPress 5.3 and later behavior
WordPress changed the core implementation in version 5.3. Instead of relying on a site-wide Disallow: / entry in robots.txt, core began emitting a robots meta directive. The change was intended to discourage listing more effectively and avoid the limitation that a crawler blocked by robots.txt cannot inspect the page for a noindex instruction. A site can still have a separate plugin, theme, or server rule that adds a crawl block, so inspect the actual robots.txt response when troubleshooting.
Choose the right mechanism for the scope
| Method | Scope | Crawler can fetch the URL? | Search-exclusion strength | Access restriction |
|---|---|---|---|---|
| WordPress Reading checkbox | Whole WordPress front end | Yes, unless another rule blocks it | Site-wide noindex request; current core also emits nofollow | None |
| HTML robots meta tag | Individual HTML responses | Yes, required to read it | Page-level noindex request | None |
X-Robots-Tag |
Any HTTP resource, including files | Yes, required to read it | Resource-level noindex request | None |
robots.txt Disallow |
Path patterns for crawling | Usually no | Not a dependable removal method | None |
| Password, login, or server authentication | Protected areas or entire site | No without credentials | Search crawlers cannot inspect the protected response | Yes |
Verify that WordPress is sending the intended directive
1. Inspect rendered page source
Open the public page in a browser, choose the command that displays the page source, and search for noindex. Check the raw HTML delivered for an anonymous visitor, not merely the editor preview. For a site-wide setting, look for a robots tag containing noindex,nofollow. For a selective rule, confirm that the intended URL has its own noindex tag and that an unrelated URL does not.
Do these 3 things before closing this tab:
1Fix the driver behind crashes, sound loss and screen glitches2Clear out junk files and repair common Windows errors3Scan for outdated or missing drivers - takes under a minute2. Check WordPress Site Health
Open Tools > Site Health. WordPress provides a search-engine-visibility diagnostic that reports when search engines are being discouraged. Treat this as a WordPress configuration check, then confirm the actual page source because themes, plugins, caches, and server layers can alter the final response.
3. Use Google Search Console
In Google Search Console, use URL Inspection for a specific address or review the Page Indexing report. These reports can indicate that Google detected noindex, encountered a robots.txt block, or found another indexing condition. Inspection reflects Google’s latest crawl and can lag behind a change you just saved.
Best Value
- Compatible with Wide Screens - To ensure compatibility with the dual monitor mount, your each monitor must meet three conditions at the same time: First, computer screens size range: 13 to 32 inches. Second, screen weight range: 4.4 to 19.8 lbs. Third, the back of the monitor screen must have VESA mounting holes with a pitch of 75x75mm or 100x100mm.
- Regarding the compatibility with desks - Your desk must meet three conditions at the same time: First, desk material: Only wooden desks are recommended, plastic or glass desks cannot be used. Second, desk thickness range: 0.59" - 3.54". Third, the bottom of the desk should not have any cross beams or panels, as this will interfere with installation. We recommend carefully checking that your desk and monitors meets all above conditions before purchasing.
- Dual C-Clamp Hold - Worried your dual monitors might wobble or slip? Our upgraded base uses a larger platform plus a dual C-clamp structure to lock the dual monitor arm firmly to your desk. Each arm safely keeps your screens steady while you type, click and game—no shaking, no sliding, just a clean and secure setup you can trust every day. It also provides Grommet Mounting installation choice, both options ensure stable and secure fixation for your 0.59" - 3.54" desk.
- Full-Motion Adjustment For Comfortable View - Pull the screen closer when you’re deep in a spreadsheet, push it back to watch videos, or rotate to portrait for coding — moving everything smoothly with just one hand. The monitor stand offers +85°/-50° tilt, ±90° swivel and 360° rotation. Raise your monitor up to 15.75″ to support a healthy sitting posture. Whether you’re working from home, gaming through the night, or switching between video calls and documents, getting the screens to your natural line of sight helps relieve neck, shoulder and back strain so you can stay focused longer with less fatigue.
- Keep Your Desk Organized: By lifting both screens off the desktop, this dual monitor stand opens up valuable space for your keyboard, notebook, docking station or a simple, clutter-free work area. Built-in cable management guides wires along the arms, keeping cords out of sight and out of the way. Enjoy a tidy, modern workstation that looks as good as it feels to use.
4. Check the HTTP response for files
For a PDF, image, feed, or other non-HTML resource, inspect the response headers and look for X-Robots-Tag: noindex. Viewing an HTML page’s source will not reveal a header attached to a different resource.
Troubleshoot common failures
The checkbox is enabled, but source contains no noindex
- Confirm that you clicked Save Changes and reload the public page while logged out.
- Check whether the theme calls
wp_headin its header template. Without that hook, WordPress cannot print its standard head output. - Purge page, object, CDN, and reverse-proxy caches, then inspect the uncached response.
- Review SEO plugins and custom theme code for filters that remove or replace robots directives.
- Check server or hosting headers; a server-level directive can differ from the HTML source.
The source has noindex, but Google still lists the URL
- Allow time for Google to recrawl and process the changed response.
- In Search Console, inspect the URL’s latest crawl state rather than relying on an old indexed result.
- Look for a simultaneous
robots.txtblock. Remove the block so Google can fetch and confirm noindex. - Make sure the noindex is on the exact canonical public URL you are checking, not only on a redirect target or a different URL variant.
- Check caches and multiple delivery layers for inconsistent responses between requests.
Search Console reports “blocked by robots.txt”
A blocked crawler cannot reliably read a meta tag or header. Remove the conflicting Disallow rule for the URL, deploy the noindex response, and request a fresh inspection when appropriate. Keep a crawl block only when limiting fetching—not when the primary objective is removal from search.
The Tool Desk
Outbyte Driver Updater FREEFix the driver behind crashes, sound loss and screen glitchesFind Drivers →Outbyte PC Repair FREEClear out junk files and repair common Windows errorsFree Scan →Only some pages are excluded
That usually indicates page-level rules rather than the global Reading setting. Inspect the affected templates, post-level SEO controls, archive logic, and response headers. A plugin or custom condition may be adding noindex to a post type, taxonomy, author archive, or other subset.
The site must not be visible before launch
Do not rely on the checkbox. Add password protection, require user authentication, or restrict the site at the hosting or server layer. Test the site in a private browser session and verify that an unauthenticated request receives a login prompt or denial instead of the content.
Quick Recap
A practical staging and launch workflow
While building
- Protect the staging site with authentication when unpublished content must remain inaccessible.
- Enable the WordPress search-visibility checkbox as an additional signal against accidental indexing.
- Check
robots.txt, theme output, plugin settings, and caches so you know which layer is controlling each behavior. - Do not submit staging URLs to search tools or public sitemaps.
Before launch
- Decide whether the site should be publicly crawlable or whether selected sections should remain excluded.
- If the entire site is going live, clear the WordPress checkbox and save.
- If only selected URLs should stay out of search, leave the global setting off and retain page-level or header-level noindex rules for those URLs.
- Remove accidental blanket crawl blocks that would prevent search engines from fetching public pages.
- Purge caches and inspect source and headers from the public production URLs.
After launch
- Use Site Health to confirm WordPress is not still discouraging indexing globally.
- Inspect representative URLs in Search Console and watch the Page Indexing report for unexpected noindex or robots-blocked statuses.
- Recheck after theme, SEO, hosting, or caching changes because any of those can alter robots output.
Important limits and edge cases
- The site-wide option applies to front-end output generated through WordPress’s normal head pathway; custom endpoints or files may need their own headers.
- A noindex instruction is not a guarantee that every search engine will comply. It is a crawler directive, not an access-control mechanism.
- Blocking a URL in
robots.txtcan hide the very directive you need Google to read. - Different URL forms can produce different responses. Test the exact protocol, host, path, and query form that appears in search.
- Caches can create a temporary mismatch between what WordPress is configured to emit and what a crawler receives.
Quick decision checklist
- Need to discourage indexing everywhere? Use Settings > Reading > Search Engine Visibility, enable the checkbox, and save.
- Need to exclude one HTML URL? Add a robots meta tag with
noindexto that response. - Need to exclude a PDF or other file? Send an
X-Robots-Tag: noindexheader. - Need Google to read noindex? Keep the URL fetchable; do not block it first in
robots.txt. - Need real confidentiality? Require authentication or password protection.
- Need proof it worked? Check page source or headers, WordPress Site Health, and Google Search Console.
Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.
