I'm trying to do a bulk whois lookup of around 7000 domains. I use the node js package whois.

This worked while I tested with individual domains.

After I made a bulk request for batch of 50 domins, it stopped giving me data.

The response I get is as follows

% This is the RIPE Database query service.
% The objects are in RPSL format.
% The RIPE Database is subject to Terms and Conditions.
% See http://www.ripe.net/db/support/db-terms-conditions.pdf

% Note: this output has been filtered.
%       To receive output for a database update, use the "-B" flag.

%ERROR:101: no entries found
% No entries found in source RIPE.

% This query was served by the RIPE Database Query Service version 1.91.2 (ANGUS)

But the request was run for existing domains.

What is going wrong? Now even individual requests are returning this for me. Am I blacklisted or something? Is there a rate limit?

  • 1
    Next time, you should ask RIPE and not us. They have a great support. – user36472 Apr 26 '18 at 9:14
  • Unfortunately, questions about protocols above OSI layer-4 are off-topic here. You could try to ask this question on Server Fault for a business network, or on Super User for a personal network. – Ron Maupin Apr 26 '18 at 13:46
  • Thanks for your help @RonMaupin. I'll keep this in mind. – Shabin Muhammed Apr 29 '18 at 6:58

The various regional internet registries have varying policies for bulk whois.

I know that RIPE has rate limiting for personal information; and may well have for queries in general. You might find that one of RIPE's other interfaces is better suited for what you're doing, as it has many APIs, not just conventional whois. See https://www.ripe.net/manage-ips-and-asns/db/support/querying-the-ripe-database

EDIT: RIPE is pretty clear about its policies and limits, see its Query Reference Manual, and Acceptable Use Policy, which give the details.

  • Thanks a lot for this @jonathanjo, It was very informative. I didn't even know what ripe was. – Shabin Muhammed Apr 29 '18 at 8:01

Not the answer you're looking for? Browse other questions tagged or ask your own question.