{"id":176,"date":"2014-11-07T17:31:29","date_gmt":"2014-11-07T17:31:29","guid":{"rendered":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/?p=176"},"modified":"2015-07-13T19:24:22","modified_gmt":"2015-07-13T19:24:22","slug":"apple-webcrawler-scours-internet","status":"publish","type":"post","link":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/seo-helpful-hints\/apple-webcrawler-scours-internet\/","title":{"rendered":"Apple Webcrawler scours the internet."},"content":{"rendered":"

Looks like apple is kick up a notch its search functions to provide spotlight with more to work with. \u00a0When you compare Google now vs spotlight\/Siri the need for more information becomes obvious. \u00a0Apple does have a long way to go to be able to compete against Google the seemingly insurmountable search giant.<\/p>\n

Currently it looks like the crawler is targeting just the html and not the css or JavaScript, however there will probable be a shift to grabbing that as well in the future.<\/p>\n

How this fairs with Bing must be unnerving as Microsoft’s search engine currently is essential the backbone of what apple relies on for web search back fill.<\/p>\n","protected":false},"excerpt":{"rendered":"

Looks like apple is kick up a notch its search functions to provide spotlight with more to work with. \u00a0When<\/p>\n","protected":false},"author":1,"featured_media":235,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"colormag_page_container_layout":"default_layout","colormag_page_sidebar_layout":"default_layout","_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[1],"tags":[],"class_list":["post-176","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-seo-helpful-hints"],"yoast_head":"\nApple Webcrawler scours the internet<\/title>\n<meta name=\"description\" content=\"Apple latest attempt to take on google in the search world spotted. Apples web crawler indexing the internet html pages for its virtual assistant.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.scoutbuffalowebdesign.com\/blog\/seo-helpful-hints\/apple-webcrawler-scours-internet\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Apple Webcrawler scours the internet\" \/>\n<meta property=\"og:description\" content=\"Apple latest attempt to take on google in the search world spotted. Apples web crawler indexing the internet html pages for its virtual assistant.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.scoutbuffalowebdesign.com\/blog\/seo-helpful-hints\/apple-webcrawler-scours-internet\/\" \/>\n<meta property=\"og:site_name\" content=\"Scout Buffalo Blog\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/ScoutBuffaloWebDesign\" \/>\n<meta property=\"article:author\" content=\"www.facebook.com\/thomas.rogers.9231\" \/>\n<meta property=\"article:published_time\" content=\"2014-11-07T17:31:29+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2015-07-13T19:24:22+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.scoutbuffalowebdesign.com\/blog\/wp-content\/uploads\/2014\/11\/web.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1280\" \/>\n\t<meta property=\"og:image:height\" content=\"960\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Thomas Rogers\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Thomas Rogers\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.scoutbuffalowebdesign.com\\\/blog\\\/seo-helpful-hints\\\/apple-webcrawler-scours-internet\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.scoutbuffalowebdesign.com\\\/blog\\\/seo-helpful-hints\\\/apple-webcrawler-scours-internet\\\/\"},\"author\":{\"name\":\"Thomas Rogers\",\"@id\":\"https:\\\/\\\/www.scoutbuffalowebdesign.com\\\/blog\\\/#\\\/schema\\\/person\\\/853010a66571f269cc2ce7f1eea1bb4d\"},\"headline\":\"Apple Webcrawler scours the internet.\",\"datePublished\":\"2014-11-07T17:31:29+00:00\",\"dateModified\":\"2015-07-13T19:24:22+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.scoutbuffalowebdesign.com\\\/blog\\\/seo-helpful-hints\\\/apple-webcrawler-scours-internet\\\/\"},\"wordCount\":119,\"publisher\":{\"@id\":\"https:\\\/\\\/www.scoutbuffalowebdesign.com\\\/blog\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/www.scoutbuffalowebdesign.com\\\/blog\\\/seo-helpful-hints\\\/apple-webcrawler-scours-internet\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.scoutbuffalowebdesign.com\\\/blog\\\/wp-content\\\/uploads\\\/2014\\\/11\\\/web.jpg\",\"articleSection\":[\"SEO Helpful Hints\"],\"inLanguage\":\"en\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.scoutbuffalowebdesign.com\\\/blog\\\/seo-helpful-hints\\\/apple-webcrawler-scours-internet\\\/\",\"url\":\"https:\\\/\\\/www.scoutbuffalowebdesign.com\\\/blog\\\/seo-helpful-hints\\\/apple-webcrawler-scours-internet\\\/\",\"name\":\"Apple Webcrawler scours the internet\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.scoutbuffalowebdesign.com\\\/blog\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.scoutbuffalowebdesign.com\\\/blog\\\/seo-helpful-hints\\\/apple-webcrawler-scours-internet\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.scoutbuffalowebdesign.com\\\/blog\\\/seo-helpful-hints\\\/apple-webcrawler-scours-internet\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.scoutbuffalowebdesign.com\\\/blog\\\/wp-content\\\/uploads\\\/2014\\\/11\\\/web.jpg\",\"datePublished\":\"2014-11-07T17:31:29+00:00\",\"dateModified\":\"2015-07-13T19:24:22+00:00\",\"description\":\"Apple latest attempt to take on google in the search world spotted. Apples web crawler indexing the internet html pages for its virtual assistant.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.scoutbuffalowebdesign.com\\\/blog\\\/seo-helpful-hints\\\/apple-webcrawler-scours-internet\\\/#breadcrumb\"},\"inLanguage\":\"en\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.scoutbuffalowebdesign.com\\\/blog\\\/seo-helpful-hints\\\/apple-webcrawler-scours-internet\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en\",\"@id\":\"https:\\\/\\\/www.scoutbuffalowebdesign.com\\\/blog\\\/seo-helpful-hints\\\/apple-webcrawler-scours-internet\\\/#primaryimage\",\"url\":\"https:\\\/\\\/www.scoutbuffalowebdesign.com\\\/blog\\\/wp-content\\\/uploads\\\/2014\\\/11\\\/web.jpg\",\"contentUrl\":\"https:\\\/\\\/www.scoutbuffalowebdesign.com\\\/blog\\\/wp-content\\\/uploads\\\/2014\\\/11\\\/web.jpg\",\"width\":1280,\"height\":960},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.scoutbuffalowebdesign.com\\\/blog\\\/seo-helpful-hints\\\/apple-webcrawler-scours-internet\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.scoutbuffalowebdesign.com\\\/blog\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Apple Webcrawler scours the internet.\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.scoutbuffalowebdesign.com\\\/blog\\\/#website\",\"url\":\"https:\\\/\\\/www.scoutbuffalowebdesign.com\\\/blog\\\/\",\"name\":\"Scout Buffalo Blog\",\"description\":\"Helping People Connect\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.scoutbuffalowebdesign.com\\\/blog\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.scoutbuffalowebdesign.com\\\/blog\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.scoutbuffalowebdesign.com\\\/blog\\\/#organization\",\"name\":\"Scout Buffalo Web Design\",\"url\":\"https:\\\/\\\/www.scoutbuffalowebdesign.com\\\/blog\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en\",\"@id\":\"https:\\\/\\\/www.scoutbuffalowebdesign.com\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/www.scoutbuffalowebdesign.com\\\/blog\\\/wp-content\\\/uploads\\\/2015\\\/07\\\/logo-scout-buffalo-web-design.png\",\"contentUrl\":\"https:\\\/\\\/www.scoutbuffalowebdesign.com\\\/blog\\\/wp-content\\\/uploads\\\/2015\\\/07\\\/logo-scout-buffalo-web-design.png\",\"width\":166,\"height\":50,\"caption\":\"Scout Buffalo Web Design\"},\"image\":{\"@id\":\"https:\\\/\\\/www.scoutbuffalowebdesign.com\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/ScoutBuffaloWebDesign\",\"https:\\\/\\\/x.com\\\/scoutwebdesign\",\"https:\\\/\\\/instagram.com\\\/scoutbuffalowebdesign\",\"https:\\\/\\\/www.linkedin.com\\\/company\\\/scout-buffalo-web-design\",\"https:\\\/\\\/myspace.com\\\/scoutbuffalowebdesign\",\"https:\\\/\\\/www.youtube.com\\\/user\\\/ScoutWebdesign\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.scoutbuffalowebdesign.com\\\/blog\\\/#\\\/schema\\\/person\\\/853010a66571f269cc2ce7f1eea1bb4d\",\"name\":\"Thomas Rogers\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/7d66ea216d4d92b2a5efd8a7da123a3cd61ac98c894e860dee7701e72c93db56?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/7d66ea216d4d92b2a5efd8a7da123a3cd61ac98c894e860dee7701e72c93db56?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/7d66ea216d4d92b2a5efd8a7da123a3cd61ac98c894e860dee7701e72c93db56?s=96&d=mm&r=g\",\"caption\":\"Thomas Rogers\"},\"description\":\"Founder and Web Developer\",\"sameAs\":[\"http:\\\/\\\/www.scoutbuffalowebdesign.com\",\"www.facebook.com\\\/thomas.rogers.9231\",\"https:\\\/\\\/x.com\\\/scoutwebdesign\"],\"url\":\"https:\\\/\\\/www.scoutbuffalowebdesign.com\\\/blog\\\/author\\\/admin\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Apple Webcrawler scours the internet","description":"Apple latest attempt to take on google in the search world spotted. Apples web crawler indexing the internet html pages for its virtual assistant.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/seo-helpful-hints\/apple-webcrawler-scours-internet\/","og_locale":"en_US","og_type":"article","og_title":"Apple Webcrawler scours the internet","og_description":"Apple latest attempt to take on google in the search world spotted. Apples web crawler indexing the internet html pages for its virtual assistant.","og_url":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/seo-helpful-hints\/apple-webcrawler-scours-internet\/","og_site_name":"Scout Buffalo Blog","article_publisher":"https:\/\/www.facebook.com\/ScoutBuffaloWebDesign","article_author":"www.facebook.com\/thomas.rogers.9231","article_published_time":"2014-11-07T17:31:29+00:00","article_modified_time":"2015-07-13T19:24:22+00:00","og_image":[{"width":1280,"height":960,"url":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/wp-content\/uploads\/2014\/11\/web.jpg","type":"image\/jpeg"}],"author":"Thomas Rogers","twitter_misc":{"Written by":"Thomas Rogers","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/seo-helpful-hints\/apple-webcrawler-scours-internet\/#article","isPartOf":{"@id":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/seo-helpful-hints\/apple-webcrawler-scours-internet\/"},"author":{"name":"Thomas Rogers","@id":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/#\/schema\/person\/853010a66571f269cc2ce7f1eea1bb4d"},"headline":"Apple Webcrawler scours the internet.","datePublished":"2014-11-07T17:31:29+00:00","dateModified":"2015-07-13T19:24:22+00:00","mainEntityOfPage":{"@id":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/seo-helpful-hints\/apple-webcrawler-scours-internet\/"},"wordCount":119,"publisher":{"@id":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/#organization"},"image":{"@id":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/seo-helpful-hints\/apple-webcrawler-scours-internet\/#primaryimage"},"thumbnailUrl":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/wp-content\/uploads\/2014\/11\/web.jpg","articleSection":["SEO Helpful Hints"],"inLanguage":"en"},{"@type":"WebPage","@id":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/seo-helpful-hints\/apple-webcrawler-scours-internet\/","url":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/seo-helpful-hints\/apple-webcrawler-scours-internet\/","name":"Apple Webcrawler scours the internet","isPartOf":{"@id":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/seo-helpful-hints\/apple-webcrawler-scours-internet\/#primaryimage"},"image":{"@id":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/seo-helpful-hints\/apple-webcrawler-scours-internet\/#primaryimage"},"thumbnailUrl":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/wp-content\/uploads\/2014\/11\/web.jpg","datePublished":"2014-11-07T17:31:29+00:00","dateModified":"2015-07-13T19:24:22+00:00","description":"Apple latest attempt to take on google in the search world spotted. Apples web crawler indexing the internet html pages for its virtual assistant.","breadcrumb":{"@id":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/seo-helpful-hints\/apple-webcrawler-scours-internet\/#breadcrumb"},"inLanguage":"en","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.scoutbuffalowebdesign.com\/blog\/seo-helpful-hints\/apple-webcrawler-scours-internet\/"]}]},{"@type":"ImageObject","inLanguage":"en","@id":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/seo-helpful-hints\/apple-webcrawler-scours-internet\/#primaryimage","url":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/wp-content\/uploads\/2014\/11\/web.jpg","contentUrl":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/wp-content\/uploads\/2014\/11\/web.jpg","width":1280,"height":960},{"@type":"BreadcrumbList","@id":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/seo-helpful-hints\/apple-webcrawler-scours-internet\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Apple Webcrawler scours the internet."}]},{"@type":"WebSite","@id":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/#website","url":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/","name":"Scout Buffalo Blog","description":"Helping People Connect","publisher":{"@id":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en"},{"@type":"Organization","@id":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/#organization","name":"Scout Buffalo Web Design","url":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en","@id":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/wp-content\/uploads\/2015\/07\/logo-scout-buffalo-web-design.png","contentUrl":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/wp-content\/uploads\/2015\/07\/logo-scout-buffalo-web-design.png","width":166,"height":50,"caption":"Scout Buffalo Web Design"},"image":{"@id":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/ScoutBuffaloWebDesign","https:\/\/x.com\/scoutwebdesign","https:\/\/instagram.com\/scoutbuffalowebdesign","https:\/\/www.linkedin.com\/company\/scout-buffalo-web-design","https:\/\/myspace.com\/scoutbuffalowebdesign","https:\/\/www.youtube.com\/user\/ScoutWebdesign"]},{"@type":"Person","@id":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/#\/schema\/person\/853010a66571f269cc2ce7f1eea1bb4d","name":"Thomas Rogers","image":{"@type":"ImageObject","inLanguage":"en","@id":"https:\/\/secure.gravatar.com\/avatar\/7d66ea216d4d92b2a5efd8a7da123a3cd61ac98c894e860dee7701e72c93db56?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/7d66ea216d4d92b2a5efd8a7da123a3cd61ac98c894e860dee7701e72c93db56?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/7d66ea216d4d92b2a5efd8a7da123a3cd61ac98c894e860dee7701e72c93db56?s=96&d=mm&r=g","caption":"Thomas Rogers"},"description":"Founder and Web Developer","sameAs":["http:\/\/www.scoutbuffalowebdesign.com","www.facebook.com\/thomas.rogers.9231","https:\/\/x.com\/scoutwebdesign"],"url":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/author\/admin\/"}]}},"_links":{"self":[{"href":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/wp-json\/wp\/v2\/posts\/176","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/wp-json\/wp\/v2\/comments?post=176"}],"version-history":[{"count":1,"href":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/wp-json\/wp\/v2\/posts\/176\/revisions"}],"predecessor-version":[{"id":177,"href":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/wp-json\/wp\/v2\/posts\/176\/revisions\/177"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/wp-json\/wp\/v2\/media\/235"}],"wp:attachment":[{"href":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/wp-json\/wp\/v2\/media?parent=176"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/wp-json\/wp\/v2\/categories?post=176"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.scoutbuffalowebdesign.com\/blog\/wp-json\/wp\/v2\/tags?post=176"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}