The robots.txt exclusion standard is a bit of an ambiguous convention, acting as sort of the opposite of a sitemap. But while one might see the value in telling a web crawler what pages are on your site, and how they’re structured, it’s more difficult to see the value of telling them where they can’t […]
Tag Archives: Robots.txt
Search Engine Optimisation
SEO in 2023: How AI and Voice Search Are Changing the Game
8th September 2023
With every passing year, the digital landscape transforms, and SEO is no exception. As we [...]
Continue reading →Online Marketing Resources
Black Friday Planning
26th October 2022
Hiding your Black Friday specials up until the last minute might seem like a good [...]
Continue reading →News Retention Marketing
POPI Act In Effect 1st July
31st March 2021
Just a quick reminder that the provisions of the Protection of Personal Information Act (POPIA) [...]
Continue reading →Online Marketing Social Media
Apple Update Impact On Facebook
31st March 2021
Apple’s recently delayed, but nonetheless upcoming, update to iOS14 (i)S 14.5) will include the already [...]
Continue reading →Online Marketing
Google, Facebook & The News
26th February 2021
It has been a tumultuous month for Facebook and Google, as the world watched with [...]
Continue reading →