Robot | Path | Permission |
GoogleBot | / | ✔ |
BingBot | / | ✔ |
BaiduSpider | / | ✔ |
YandexBot | / | ✔ |
Title | robots.txt checker |
Description | The robots.txt checker tool shows you whether your robots.txt file blocks web crawlers from specific URLs on your site. |
Keywords | N/A |
WebSite | www.robots-txt.net |
Host IP | 5.9.6.163 |
Location | Germany |
Site | Rank |
cimtools.net | #8,247,775 |
webrobots.de | #2,687,491 |
grsxth.blogspot.com | #2,400,505 |
webuseragents.com | #3,539,089 |
rockmore.ir |
rolliteirk.com |
rotavrupa.com |
roumeliotisgroup.com |
rozetkin.com.ua |
rrr.co.ir |
rseventures.com |
rsnpropertygroup.com |
rtiger.com |
rudomilov.ru |
longdrivefederation.org |
ma-krueger-bau.de |
US$1,929
Last updated: Jan 26, 2020
Robots-txt.net has global traffic rank of 8,734,038. Robots-txt.net has an estimated worth of US$ 1,929, based on its estimated Ads revenue. Robots-txt.net receives approximately 352 unique visitors each day. Its web server is located in Germany, with IP address 5.9.6.163. According to SiteAdvisor, robots-txt.net is safe to visit. |
Purchase/Sale Value | US$1,929 |
Daily Ads Revenue | US$1 |
Monthly Ads Revenue | US$31 |
Yearly Ads Revenue | US$385 |
Daily Unique Visitors | 352 |
Note: All traffic and earnings values are estimates. |
Global Rank | 8,734,038 |
Delta (90 Days) | 0 |
Most Popular In Country | N/A |
Country Rank | N/A |
Host | Type | TTL | Data |
robots-txt.net | A | 1798 | IP: 5.9.6.163 |
robots-txt.net | MX | 1799 | Priority: 15 Target: eforward4.registrar-servers.com. |
robots-txt.net | MX | 1799 | Priority: 10 Target: eforward1.registrar-servers.com. |
robots-txt.net | MX | 1799 | Priority: 10 Target: eforward2.registrar-servers.com. |
robots-txt.net | MX | 1799 | Priority: 10 Target: eforward3.registrar-servers.com. |
robots-txt.net | MX | 1799 | Priority: 20 Target: eforward5.registrar-servers.com. |
robots-txt.net | NS | 1799 | Target: dns2.registrar-servers.com. |
robots-txt.net | NS | 1799 | Target: dns1.registrar-servers.com. |
robots-txt.net | TXT | 1799 | TXT: v=spf1 include:spf.efwd.registrar-servers.com ~all |
robots-txt.net | SOA | 3600 | MNAME: dns1.registrar-servers.com. RNAME: hostmaster.registrar-servers.com. Serial: 1573496284 Refresh: 43200 Retry: 3600 Expire: 604800 Minimum TTL: 3601 |
HTTP/1.1 200 OK Server: nginx/1.4.6 (Ubuntu) Date: Sun, 26 Jan 2020 15:26:24 GMT Content-Type: text/html; charset=UTF-8 Content-Length: 4142 Connection: keep-alive Set-Cookie: PHPSESSID=ch25i054n5q49c2fnebi42r1q1; path=/; HttpOnly Expires: Thu, 19 Nov 1981 08:52:00 GMT Cache-Control: no-store, no-cache, must-revalidate Pragma: no-cache Set-Cookie: _csrf=faf9df963386899f3e8b0a90b4fb2a51aefbc86eadfcb6070d96894e82dabc6ea%3A2%3A%7Bi%3A0%3Bs%3A5%3A%22_csrf%22%3Bi%3A1%3Bs%3A32%3A%229ok4fJCGFqHbczcbZ4AfcGBtIpBi0J3z%22%3B%7D; path=/; HttpOnly Vary: Accept-Encoding |
Domain Name: ROBOTS-TXT.NET Registry Domain ID: 2093456031_DOMAIN_NET-VRSN Registrar WHOIS Server: whois.namecheap.com Registrar URL: http://www.namecheap.com Updated Date: 2019-12-28T06:53:22Z Creation Date: 2017-01-27T07:22:29Z Registry Expiry Date: 2021-01-27T07:22:29Z Registrar: NameCheap, Inc. Registrar IANA ID: 1068 Registrar Abuse Contact Email: abuse@namecheap.com Registrar Abuse Contact Phone: +1.6613102107 Domain Status: clientTransferProhibited https://icann.org/epp#clientTransferProhibited Name Server: DNS1.REGISTRAR-SERVERS.COM Name Server: DNS2.REGISTRAR-SERVERS.COM DNSSEC: unsigned URL of the ICANN Whois Inaccuracy Complaint Form: https://www.icann.org/wicf/ Domain name: robots-txt.net Registry Domain ID: 2093456031_DOMAIN_NET-VRSN Registrar WHOIS Server: whois.namecheap.com Registrar URL: http://www.namecheap.com Updated Date: 2019-12-28T06:53:23.04Z Creation Date: 2017-01-27T07:22:29.00Z Registrar Registration Expiration Date: 2021-01-27T07:22:29.00Z Registrar: NAMECHEAP INC Registrar IANA ID: 1068 Registrar Abuse Contact Email: abuse@namecheap.com Registrar Abuse Contact Phone: +1.6613102107 Reseller: NAMECHEAP INC Domain Status: clientTransferProhibited https://icann.org/epp#clientTransferProhibited Registry Registrant ID: Registrant Name: WhoisGuard Protected Registrant Organization: WhoisGuard, Inc. Registrant Street: P.O. Box 0823-03411 Registrant City: Panama Registrant State/Province: Panama Registrant Postal Code: Registrant Country: PA Registrant Phone: +507.8365503 Registrant Phone Ext: Registrant Fax: +51.17057182 Registrant Fax Ext: Registrant Email: 6d19d17f57bb40b1b82b530a8986f374.protect@whoisguard.com Registry Admin ID: Admin Name: WhoisGuard Protected Admin Organization: WhoisGuard, Inc. Admin Street: P.O. Box 0823-03411 Admin City: Panama Admin State/Province: Panama Admin Postal Code: Admin Country: PA Admin Phone: +507.8365503 Admin Phone Ext: Admin Fax: +51.17057182 Admin Fax Ext: Admin Email: 6d19d17f57bb40b1b82b530a8986f374.protect@whoisguard.com Registry Tech ID: Tech Name: WhoisGuard Protected Tech Organization: WhoisGuard, Inc. Tech Street: P.O. Box 0823-03411 Tech City: Panama Tech State/Province: Panama Tech Postal Code: Tech Country: PA Tech Phone: +507.8365503 Tech Phone Ext: Tech Fax: +51.17057182 Tech Fax Ext: Tech Email: 6d19d17f57bb40b1b82b530a8986f374.protect@whoisguard.com Name Server: dns1.registrar-servers.com Name Server: dns2.registrar-servers.com DNSSEC: unsigned URL of the ICANN WHOIS Data Problem Reporting System: http://wdprs.internic.net/ |