Mastering Crawling: Insights and Best Practices

 

Explore content related to Crawling and master insights along with best practices with Belmore Digital’s Expert Digital Marketing & SEO Consultancy.

What Does It Actually Take to Appear in AI-Generated Answers?

2026-10-19T14:48:20+11:00Categories: Content Strategy & Creation, GEO - Generative Engine Optimisation, SEO, Virtual Chief Digital Officer|Tags: , , , , , , , , , , |

Appearing in AI answers takes a site AI crawlers can read, pages that say what you do, and other sites backing you up. JB sets out the work, in order.

What is GEO? Generative Engine Optimisation Explained

2026-10-19T14:47:24+11:00Categories: Digital Marketing & Strategy, GEO - Generative Engine Optimisation, SEO, Virtual Chief Marketing Officer|Tags: , , , , , , , , , |

GEO is how a business gets named, and described correctly, in AI answers from Google, ChatGPT and the rest. JB explains what decides it and what the work involves.

Navigating Technical SEO and Security for Enhanced Visibility

2025-07-08T16:21:18+10:00Categories: Belmore Digital Case Studies, Development & Technology Case Studies, SEO Case Studies, Training & Upskilling Case Studies, Virtual Chief Digital Officer Case Studies|Tags: , , , , , , , , |

In a tightly regulated industry, one enterprise struggled to make its site visible without exposing security risks. Belmore Digital bridged the gap between SEO and IT—resolving domain, subdomain, and access issues while preserving enterprise-grade protections. The result: enhanced search visibility and zero compromises on security.

Improving Site Structure and User Experience for an Insurance Provider

2025-07-08T16:29:08+10:00Categories: Analytics & Performance Case Studies, Belmore Digital Case Studies, Content Strategy & Creation Case Studies, Conversions & CRO Case Studies, Email & CRM Case Studies, SEO Case Studies|Tags: , , , , , , , , , , , |

A national insurance provider’s content-rich website was underperforming—confusing users and search engines alike. Belmore Digital led a full site structure overhaul, improving navigation, content clarity, and internal linking. The result? Higher rankings, better engagement, and a more strategic foundation for future growth.

JB’s Digital Update 21st August 2024

2024-08-21T17:00:52+10:00Categories: Content Strategy & Creation, Digital Marketing & Strategy, JB's Digital Update, PPC & Paid Social, SEO, Social Media Management, Technology & Development|Tags: , , , , , , , , , , |

It’s been a little while! Unfortunately, I had to take some time out to deal with some family matters, but I’m baaaack :-) This week in JB’s Digital Update: Google’s AI shakes up search, YouTube Shorts teaches us the art of blending in, Reddit’s CEO throws shade at Microsoft, ad prices continue to climb, and Google faces a legal smackdown for antitrust violations. Get the lowdown on how these developments could affect your digital strategy and bring it down low. Or something.

Unlocking the Secrets of Robots.txt: Your Digital Guardian in the Online Realm

2026-04-21T20:48:23+10:00Categories: Analytics & Performance, Content Strategy & Creation, CRO and Conversions, Digital Marketing & Strategy, Email & Customer Relations, SEO, Social Media Management, Technology & Development|Tags: , , , , , , , , , , |

🤖🗺️ Ever wondered how search engines navigate the intricate web to find the information you seek? 🔍 Embark on the journey of mastering the art of Robots.txt. Don't let your site roam freely – craft a powerful digital rulebook with our step-by-step guide with Belmore Digital. 🚀

JB’s Digital Update 29th August 2023

2026-04-21T20:54:52+10:00Categories: Analytics & Performance, Content Strategy & Creation, Digital Marketing & Strategy, JB's Digital Update, PPC & Paid Social, SEO, Social Media Management, Technology & Development|Tags: , , , , , , , , , , , , , , , , , , , , |

What an exciting AI filled week it’s been. Just like many other weeks recently. Some brands are now blocking GPTBot (until offered cash, no doubt), Lyft is slapping ads into its app, Meta is being useful, Google is actually stopping UA processing (sniff), and there’s been another Google Core Update to pontificate over. Interested? Dive in for more. 

JB’s Digital Update 15th August 2023

2026-04-21T20:55:39+10:00Categories: Content Strategy & Creation, CRO and Conversions, Digital Marketing & Strategy, Email & Customer Relations, JB's Digital Update, PPC & Paid Social, SEO, Technology & Development, Virtual Chief Marketing Officer|Tags: , , , , , , , , , , , , , , , , |

This week turned into a bit of an AI-Google fest, blathering on about the challenges of controlling AI access to your hard-crafted content, vs Google wanting full access. There are also changes to FAQ & How To's on the SERP, presumably due to spam, some sage advice re content pruning, and a good guide to AI-driven PMax Google Ads campaigns. Read it and educate yourself ;-)

Googlebot Doesn’t Crawl HTTP/2

2023-12-05T20:16:23+11:00Categories: SEO News|Tags: , , , , |

Despite championing HTTP/2 and the speed advantages that come with it, googlebot doesn't crawl pure HTTP/2 connections, or so it seems. It's a bit arcane and technical, but it's also a bit surprising. Read more in this extract from TWIS SEO News & Updates w/e 20th October 2017. #SEO #SEONews #Googlebot #Crawling #HTTP2

Go to Top