The Trouble with JavaScript and News Sites
The Trouble with JavaScript and News SitesJavaScript is unavoidable on the modern web, but best used sparingly. Google says it indexes JavaScript, but the realities are a lot more complex.To say my relationship with JavaScript is antagonistic would be an understatement. I have a long and colourful history of ranting about the dangers of JavaScript in the context of SEO, which I will not repeat here. If you’re interested and have some time to spare, these two talks I gave in 2018 and 2019 respectively will serve to set the context: Technical SEO in the Wild - Real World Issues and FixesJavaScript is Ruining the WebI’m far from alone in pointing out the issues with JavaScript and SEO. The folks are Onely are among the best when it comes to R&D in this area, and they’re generous with their knowledge. Here’s a great resource from them that highlights the most common issues JavaScript can cause for SEO: » 10 Most Common SEO JavaScript Issues and How to Fix Them In the context of news websites, JavaScript poses additional challenges. News moves fast and fresh articles are published at an astounding rate. Google is constantly crawling news sites to find newly published URLs and index them rapidly. When you have critical page content relying on client-side JavaScript, Google will need to render the page to index that content. This introduces a delay in Google’s indexing process, because rendering is far from rapid. In fact, research from those same folks at Onely showed that JavaScript pages are crawled (and subsequently indexed) nine times slower than pages that contain all their content and links in the raw HTML. Considering the speed with which news moves, I’m not sure a publisher can afford to be nine times slower than their competitors to get their stories crawled by Google. In fact, this is a quote from Google’s technical guidelines for news publishers:
The message is clear: don’t use JavaScript to load article content. But these recommendations are based on extreme scenarios where the page’s content is entirely loaded with client-side JavaScript. Fortunately for news publishers this is exceedingly rare. There are, however, plenty of other implementations of JavaScript that don’t directly interfere with Google’s ability to index article content, but still cause issues with the site’s SEO. Here are the most common JavaScript-related problems I see on publishing sites: Navigation MenuTop navigation menus often have a fold-out feature to show more links. Especially on mobile resolutions, fold-out hamburger menus are a common practice. In and of itself, this doesn’t have to be an issue - as long as the links contained in the menu are already present in the HTML source. Their presence in the HTML means Google can see the navigation links there and crawl them without issue. It also tells Google what your main news categories are, which will help your site’s topic authority for those categories. When fold-out menus use JavaScript to load links into the DOM, that’s when we start having problems. I see this with some regularity; the HTML only contains top-level navigation links, and the subcategory links are only loaded into the webpage when the menu is clicked. The root of the issue is that Google doesn’t click. When rendering webpages for indexing, Google doesn’t perform any actions. No clicking, no scrolling, nothing. So any content - links, text, or images - that relies on a user-action to be loaded into the webpage’s DOM are effectively invisible to Google. That includes navigation links. By hiding these navigation links from Google you’re presenting a much shallower site to the search engine, restricting Googlebot’s access to your (sub)sections. This results in less effective crawling, and weaker topic authority signals. Always make sure all your navigation links are present in the HTML and don’t require a client-side script action. PaginationA common way to implement pagination - i.e. showing more articles on a section page beyond just the first list of articles - is with Load More buttons or infinite scroll auto-loading. If you’ve paid attention so far, you’ll see the issue here. Google doesn’t scroll, and Google doesn’t click. If your site’s pagination uses JavaScript with either infinite scroll or a Load More button, chances are Google doesn’t see these additional articles on your section page. Effectively, you’re showing just a single list of articles to Google, with old stories dropping off rapidly as new articles take their place. The impact on SEO is that, as far as Google is concerned, you have a short list of articles associated with any section page. This negatively impacts on topic authority. Additionally, once articles drop off the first page of a section they lose internal link value in Google’s calculations, and their rankings will suffer accodingly (which is especially harsh for evergreen content). You’ll want your pagination to be easily crawlable and indexable for Googlebot. This means old-fashioned pagination links with unique crawlable and indexable URLs. I’ve written about optimal pagination for news publishers before. Comments & UGCIn a recent newsletter I spoke about the potential risks and benefits of allowing Google to index your reader comments and other user-generated content. Usually comment functionality is implemented with client-side JavaScript, which means Google will have trouble indexing it unless you make specific allowances. I won’t repeat my recommendations - if you’re interested, here’s the newsletter where I explore this issue in detail:
|
Older messages
Google's March 2024 Core Update
Wednesday, March 6, 2024
The latest Google core update could be a game-changer, and gives Google back control of the search quality narrative. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Turns out, Google is all about Links and Clicks
Tuesday, February 20, 2024
Internal Google documents revealed during their antitrust trial show how Google relies on user signals to evaluate content quality. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
The Impact of Article Comments on SEO
Tuesday, November 7, 2023
Allowing readers to post comments and contribute to your site is great for engagement and loyalty, but does come with some SEO repercussions.
Why Articles Should Be Optimised Before Publishing
Wednesday, October 4, 2023
One of Google's quirks means that once an article has been crawled and indexed, any changes won't necessarily be picked up by Google until it's too late.
Advanced Insights into Googlebot Crawling
Thursday, July 27, 2023
Here are some interesting aspects of Googlebot's crawling of news websites that are useful to know when you want to optimise crawl efficiency.
You Might Also Like
Kindle & Audiobook : Santa's List: A Short Christmas Story by Riley Blake
Saturday, November 23, 2024
They have big plans for an international killer with an impeccable reputation for always hitting his mark.
Ask your way to product market fit
Saturday, November 23, 2024
Use the Sean Ellis Method and the 40% Test ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
The end of productivity
Saturday, November 23, 2024
Has AI made this obsolete? ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Setting Gift-Giving Guidelines for a Minimalist Holiday Season
Saturday, November 23, 2024
Setting Gift-Giving Guidelines for a Minimalist Holiday Season A question I frequently hear from readers aspiring to live a more minimalist holiday season goes like this: “How do you handle holiday
[Electric Speed] Blind spots | Bluesky
Saturday, November 23, 2024
Plus: advent calendars | holiday cards ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
The playbook that built a $360M empire
Friday, November 22, 2024
Webinar: Learn how to convert free SaaS users into paying customers ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
• Book Promo Super Package for Authors • FB Groups • Email Newsletter • Tweets • Pins
Friday, November 22, 2024
Newsletter & social media ads for books. Enable Images to See This "ContentMo is at the top of my promotions list because I always see a spike in sales when I run one of their promotions. The
Grace and Typos
Friday, November 22, 2024
This isn't a joke about universal blood donors
Prescription for Success
Friday, November 22, 2024
New research reveals differentiators for strong results. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
🎤 The SWIPES Email (Friday, November 22nd, 2024)
Friday, November 22, 2024
The SWIPES Email Friday, November 22nd, 2024 An educational (and fun) email by Copywriting Course. Enjoy! Swipe: I love a good image that "POPS" a concept into your head really fast.