Tools LinkedIn Plans Docs FAQ
Login

Export API - streaming data export

When exporting larger amounts of records JSON objects are not suitable anymore due to the memory intense way programming languages are parsing JSON.

Our export API is exporting distinct JSON objects that are separated line by line '\n'.

The great benefit is that you do not have to handle pagination anymore, that's optional.
Our export API allows to export even large scale jobs with millions of results within one export call.

Parsing export JSON data

In a programming or scripting language you split or stream the data line by line and convert each line from JSON into a native data object.

  • PHP: foreach (explode("\n",$export_data) as $line) var_dump(json_decode($line,true));
  • Linux console: cat export.data | jq .

Not a developer?
We offer web based tools to scrape Google and export results without any API integration requirements.
Scrape and export Google search by web-tool
Scrape and export Bing search by web-tool

API documentation

We use cURL and URL examples during most of the documentation.
In the source code section you will find PHP source code that streams objects directly from our export API.

Quick start

Similar to the scraping APIs you call our export API directly with your user credentials.

  • user [required]
    your login email address
  • credentials [required]
    your API key
  • job_type [required] [string]
    • scrape_google_search
    • scrape_bing_search
  • export_format or type [required] [string]
    • csv
      Tabulator CSV format, recommended for importing into Excel or Google Sheets
    • json
      JSON format, recommended for databases and programming languages
  • jobname [required]
    The name of the job to export
  • results_per_keyword_quantity [optional]
    Optionally limit the number of results per keyword
  • start [optional] [numeric]
    Optionally define a start id to skip a certain number of records.
    This may be used to continue an incomplete export or enable pagination
  • limit [optional] [numeric]
    Optionally limit the amount of keywords exported (to be used together with 'start')
  • download [optional] [string]
    set download to send a file download header (browsers will initiate a file download)
    set download to a value to define the filename
  • human_readable [optional] [boolean]
    set human_readable to true to output JSON data in a pretty format without escaped slashes
Base URL
URL
                            https://scraping.services/export?user=_USER@ACCOUNT_&credentials=_CREDENTIALS_
# This base URL contains the credentials of your account
API credentials

URL: https://scraping.services/export
User: _USER@ACCOUNT_
Credentials: _CREDENTIALS_

Exporting Google jobs

You can export results from any job that has been started, though it is recommended to only export from finished jobs.

The Export pricing is identical to API->get_results(), 0.01 Credits per 50 keywords.

Base URL
URL
                            https://scraping.services/export?user=_USER@ACCOUNT_&credentials=_CREDENTIALS_&job_type=scrape_google_search&type=json&human_readable&jobname=_JOBNAME_
# This base URL contains the credentials of your account
Result
JSON
                        "header": {
  "jobname": "testjob_2018",
  "type": "scrape_bing_search",
  "start": 1,
  "total_results_available": 31,
  "results_per_keyword_quantity": 1
}
                    {
  "count_organic": 8,
  "count_creative": 4,
  "language": "en",
  "country": "us",
  "keyword": "best rank checker",
  "resultstats": {
    "1": 1310000
  },
  "is_broad_match": false,
  "results_organic": [
    {
      "url": "https://www.shoutmeloud.com/5-excellent-websites-to-check-keyword-ranking-in-google.html",
      "title": "5 Excellent Websites for Checking Google Keyword RankingsSEMrushBuilding Backlinks",
      "description": "5 Excellent Websites for Checking Google Keyword Rankings. ... SEOCentro Rank Checker. SEOCentro is one of the best keyword checking tools I have found to date.",
      "facts": [],
      "page": 1
    }
  ],
  "results_creative": [
    {
      "url": "semrush.com",
      "title": "Best Rank Checker Tool - Control your rankings.",
      "description": "Ad · semrush.comDiscover your competitors, improve your SEO and compete. Free trial!SEMrush Position TrackingTop 100 SERP results · >1 million users · Featured Snippets Report",
      "facts": [],
      "page": 1
    }
  ],
  "result_knowledge": null,
  "job_id": 1
}
                        
Export with 2 results per keyword
URL
                            https://scraping.services/export?user=_USER@ACCOUNT_&credentials=_CREDENTIALS_&job_type=scrape_google_search&type=json&human_readable&results_per_keyword_quantity=1&jobname=demojob
# The quantity per keyword is set to 1, overriding the job max_results setting.
Result with Google Knowledgegraph
JSON
                        {
    "header": {
        "jobname": "G09/07/2019 22:54",
        "type": "scrape_google_search",
        "start": 1,
        "total_results_available": 1,
        "results_per_keyword_quantity": 1
    }
}

{
    "count_organic": 90,
    "count_creative": 0,
    "language": "en",
    "country": "Default",
    "keyword": "Microsoft",
    "is_broad_match": false,
    "results_organic": [
        {
            "url": "https://www.microsoft.com/",
            "title": "Microsoft - Official Home Page",
            "description": "At Microsoft our mission and values are to help people and businesses throughout the world realize their full potential.",
            "sitelinks": [],
            "flags": {
                "hacked": 0,
                "harmful": 0
            },
            "page": 1
        }
    ],
    "results_creative": [],
    "result_knowledge": {
        "header_text": "Microsoft Corporation",
        "phone_text": "1 (800) 642-7676",
        "times_open": [],
        "description": "Microsoft Corporation is an American multinational technology company with headquarters in Redmond, Washington. It develops, manufactures, licenses, supports and sells computer software, consumer electronics, personal computers, and related services. Wikipedia ",
        "items_of_interest": []
    },
    "job_id": 1
}

                        

Exporting Bing jobs

You can export results from any job that has been started, though it is recommended to only export from finished jobs.

The Export pricing is identical to API->get_results(), 0.01 Credits per 50 keywords.

Base URL
URL
                            https://scraping.services/export?user=_USER@ACCOUNT_&credentials=_CREDENTIALS_&job_type=scrape_bing_search&type=json&human_readable&jobname=_JOBNAME_
# This base URL contains the credentials of your account
Result
JSON
                        {
    "header": {
        "jobname": "B09/07/2019 22:14",
        "type": "scrape_bing_search",
        "start": 1,
        "total_results_available": 1
    }
}

{
    "count_organic": 7,
    "count_creative": 0,
    "language": "en",
    "country": "Default",
    "keyword": "test",
    "resultstats": {
        "1": 1710000000
    },
    "is_broad_match": false,
    "results_organic": [
        {
            "url": "https://www.speedtest.net/",
            "title": "Speedtest by Ookla - The Global Broadband ... - Speedtest.netWindowsSettingsRemove Speedtest.net AdsSpeedtest ServersAppsOokla Internet Speed Test",
            "description": "At Ookla, we are committed to ensuring that individuals with disabilities can access all of the content at www.speedtest.net. We also strive to make all content in Speedtest apps accessible. If you are having trouble accessing www.speedtest.net or Speedtest apps, please email legal@ziffdavis.com for assistance. Please put "ADA Inquiry" in the ...",
            "facts": [],
            "page": 1
        },
        {
            "url": "https://www.merriam-webster.com/dictionary/test",
            "title": "Test | Definition of Test by ... - Merriam-Webster",
            "description": "Test definition is - a means of testing: such as. How to use test in a sentence.",
            "facts": [],
            "page": 1
        },
        {
            "url": "http://www.test.com/",
            "title": "Find online tests, practice test, and test creation ...",
            "description": "Provides extranet privacy to clients making a range of tests and surveys available to their human resources departments. Companies can test prospective and current employees. Information on surveys, certification, examination, testing and contact details.",
            "facts": [],
            "page": 1
        },
        {
            "url": "https://www.speakeasy.net/speedtest/",
            "title": "Speakeasy Internet Speed Test - Check Your Broadband Speed ...",
            "description": "The internet speed test trusted by millions. Use our free bandwidth test to check your speed and get the most from your ISP. New HTML5 speed test, no Flash required.",
            "facts": [],
            "page": 1
        },
        {
            "url": "https://testmy.net/",
            "title": "TestMy.net Broadband Internet Speed Test",
            "description": "Broadband Internet Speed Test. TestMy.net is a powerful broadband speed test that will test your Internet, calculate your transfer rate and output accurate, reliable and easy to understand results.",
            "facts": [],
            "page": 1
        },
        {
            "url": "https://www.eclecticenergies.com/enneagram/test",
            "title": "Enneagram Tests (free) - Eclectic Energies: Chakra test, I ...",
            "description": "Eclectic Energies Enneagram Tests (free) These two online Enneagram tests help you to determine which personality type you are. Your wing will also be indicated. Some suggestions on how to take the tests to get the most accurate results can be found below.. Classical enneagram test",
            "facts": [],
            "page": 1
        },
        {
            "url": "https://www.labcorp.com/test-menu/search",
            "title": "Test Menu | LabCorp",
            "description": "LabCorp test menu provides a complete list of specialty and general laboratory testing services by keyword or condition.",
            "facts": [],
            "page": 1
        }
    ],
    "results_creative": [],
    "result_knowledge": null,
    "job_id": 1
}

                    

Additional export modules

Our export API allows to search for business and person data.

We separated these parts into distinct documentation sections due to their difference to SERP exports.

Company data searches

You can use our export API to search for company records using company names or websites as criteria.

Our company database is among the worlds largest with close to 30 million entries with millions of updates every month.

Employee data searches

We currently do not provide public APIs for bulk employee searches, please contact our customer support.

Reverse email lookup

We offer the unique ability to search for employee and company data based on their email addresses.

Not a developer?
You can test our reverse email lookup online
Email to contact

Company query
URL
                            Company query API
                            

Search and export company data by website or company name