Because I work at Stanford I have a discounted subscription to the New York Times, so I'm that rarity on the Web, a paying customer. You would think they would try to make my Web browsing experience pleasant and hassle-free. So here I am, using my hotel's WiFi and Chrome on my totally up-to-date Google Nexus 9 tablet with no ad-blocker. I'm scrolling down the front page of the New York Times and I notice a story that looks interesting. My finger touches the link. And what happens next amazes me. In fact, it tips me over the edge into full-on rant mode, which starts below the fold. You have been warned, and I apologize for two rants in a row.
So, why do I pay the New York Times $7.50/month? Two reasons:
- First, in any society it is useful to know what the governing elite wants you to think. That's why Soviet citizens read Pravda. Its why Chinese citizens read the People's Daily. It's one reason I read the New York Times. For example, the governing elite wants you to believe the too-big-to-fail banks weren't to blame for the 2008 financial crash. Of course, they were to blame, but its useful to know you're not supposed to believe that.
- Second, as well as the instruction in right thinking, the paper publishes work by reporters that I usually enjoy reading. For example John Markoff, or Gretchen Morgenstern.
With that preamble out of the way, lets see what happened when I followed the link to the story:
- The first thing that happened was, well, nothing. There was a brief pause until:
- The URL in the headline bar changed from http://nytimes.com/ to the URL of the story, but I'm not seeing the story, I'm still seeing the content of the front page.
- Then the top of the story became visible in the bottom 2/3 of the window with a large blank space above it. I started to read the article.
- I got to the end of the text that was visible in the window, and scrolled down.
- I continued to read for a short time, until:
- Without me doing anything, the page jump-scrolled back to the top, so I saw the text I'd already read with an advert where the blank space had been.
- So to continue reading, I scrolled back to where I had been. The page started fighting me. As soon as I lifted my finger, the page jump-scrolled back to the top.
- I tried to scroll back again, but now the page was immovable. No matter what I did, the page had stopped scrolling. All I could see was the section of the page that was visible initially. And the ad.
I'm paying the New York Times so I can read the articles but their ad system is preventing me getting the content I HAVE PAID FOR!
I AM NOT OK WITH THIS!
Sigh! Rant over.
This actually happened back in April while I was at the IIPC's General Assembly. I wrote the rant above, put it aside to add more information, then forgot about it. I tried re-visiting the page, but of course the ad system fed me a different, less obnoxious ad, so the experience wasn't repeatable. But last week I had a similar experience, when an ad on the New York Times grabbed the page I was reading away from me so I wasn't able to finish reading it. I had to kill and restart the browser to regain control. So I was reminded of this unfinished post.
 |
| Ad ecosystem |
The problem is that the trustworthy site sells the ability to run JavaScript in your browser to all sorts of entities that are much less trustworthy via a complex ecosystem infested with fraud that Cegłowski describes thus:
Today we live in a Blade Runner world, with ad robots posing as people, and Deckard-like figures trying to expose them by digging ever deeper into our browsers, implementing Voight-Kampff machines in Javascript to decide who is human. ...No-one in this ecosystem, except the New York Times, cares about the reader's experience. If they think about depriving the reader of the ability to read the content they paid for by forcing an ad on them at all, they probably think its a great idea.
The ad networks' name for this robotic deception is 'ad fraud' or 'click fraud'. ...
Ad fraud works because the market for ads is so highly automated. Like algorithmic trading, decisions happen in fractions of a second, and matchmaking between publishers and advertisers is outside human control. It's a confusing world of demand side platforms, supply-side platforms, retargeting, pre-targeting, behavioral modeling, real-time bidding, ad exchanges, ad agency trading desks and a thousand other bits of jargon.
Because the system is so automated, and because there's no way for the reader to complain to the New York Times about an ad, especially because the reader no longer has control of their browser, and even if there were the problem is unrepeatable, the New York Times probably never even finds out that someone paid them to degrade the reader's experience. They are happily ignorant of why their customers are up to here with paying for this kind of miserable user experience.
Of course, I was lucky. The JavaScript I got was obnoxious, but wasn't actively hostile. Others weren't so lucky. Among the "trustworthy" sites found serving the Angler malware were:
It turned out that this was only one of three Angler malvertising campaigns. Similar attacks are routine. Many of them happen when systems in the complex ad ecosystem are compromised. So the trustworthiness of the New York Times as a place to visit depends on the trustworthiness and the security systems of everyone in the ad ecosystem. The New York Times probably doesn't know who the entities in the system they deal with are themselves dealing with, and who those entities are dealing with, and so on. And it certainly can't audit all their security systems to see whether they match the New York Times' (assumed to be) impenetrable security.
Publisher Traffic (monthly)* msn.com 1.3B nytimes.com 313.1M bbc.com 290.6M aol.com 218.6M my.xfinity.com 102.8M nfl.com 60.7M realtor.com 51.1M theweathernetwork.com 43M thehill.com 31.4M newsweek.com 9.9M
* Numbers pulled from SimilarWeb.com.
As John Oliver points out, news organizations are in big trouble because:
One news industry veteran, who has long since ditched newspapers for radio, once summed up the situation perfectly for me. "It's not that newspapers don't make money. They just don't make enough money for their greedy owners."They are in such desperate pursuit of these long-gone margins that they have sold off control of their user experience to the highest bidder. They wonder why people don't trust them and run ad-blockers. They refuse to supply content to those who do.
Historically, newspapers have had sky-high profit margins. At their peak in the late 90's, seven publicly traded media companies saw profit margins at nearly 30%. The now-defunct American Journalism Review even reported in October 1994 that the Warren Buffett-owned Buffalo News had a 34.6% profit margin.
Trevor Pott on The Register's Sysadmin Blog sums it up:
I'm not turning off my browser's defences. It isn't going to happen. I've been bitten one too many times by malvertising and other web nasties and those shields are staying very, very up. ... Ad blockers aren't just for the lazy and the selfish. They are part of browser defence and are absolutely mandatory on today's web. There's no getting around it: advertising has been a vector for malware for far too long. The trust is comprehensively lost and it isn't coming back.This will not end well, as the arms race between Facebook and AdBlock Plus shows. First, as Casey Johnston writes at the New Yorker, if Facebook succeeds it is another nail in the coffin of the open Web:
Publishers are caught between a rock and a hard place. Advertisers often demand that you use the ad networks they are familiar with. The ad networks see no percentage in ensuring clean ads. The publishers have little to no control. If they want to stay in business they need to advertise, and they need to use the advertising networks the advertisers demand.
To understand Facebook’s motivation, it helps to revisit Apple’s mobile ad blockers, which the company introduced last year. Apple’s mobile ad blockers, which have earned a lot of attention, work only on Safari’s mobile browser. But Apple’s entire mobile platform is built on closed-system apps, not Web-based sites. Ads served within these apps cannot be blocked by anything, not even Apple’s own ad blockers. So, by blocking Web-based ads, Apple’s move would, in theory, drive businesses away from the open mobile Web, where the future of advertising is shaky, and toward apps, where there are fewer business variables. It’s not a coincidence, either, that Apple makes money from apps through both sales and advertising, while it earns nothing from its mobile browser.Second, as Cory Doctorow writes, if AdBlock succeeds they get to censor the Web:
What was true of Apple then is even more true of Facebook now. Over the last few years, Facebook has seen rapid growth within its mobile app, where blockers don’t work and it can easily control the ad experience in the same way that Apple can control the app experience.
If online services successfully make ads and content indistinguishable to attempts to block them, content becomes the only target to work onYet again, it is lesser-of-two-evils time.
A blunter tool than ad blocking as it mostly works now (if you let it block 𝓫𝓻𝓪𝓷𝓭, you'd never see your friends talking about 𝓫𝓻𝓪𝓷𝓭), this has far greater potential for censorship and other unpleasantness, once a successful provider ends up in a middle-man position akin to the one Ad Block currently has.
Imagine how easy it would be for Ad Block 2020 to influence an election if it had evolved to understand the political meaning of any given block of content—having long ago established the legitimacy of this approach by backing user-end controls in Facebook's war on them.
In pursuit of their traditional margins, many newspapes erected paywalls. At the Financial Times, the Wall Street Journal, and the New York Times they have, despite becoming somewhat porous, been relatively successful. After all, the New York Times persuaded me to cough up.
ReplyDeleteBut Mike Masnick at Techdirt points outh that Lots Of Newspapers Discovering That Paywalls Don't Work:
"Not surprisingly, more and more newspapers that bet on paywalls are discovering that they don't really work that well and were a waste of time and effort -- and may have driven away even more readers."
Full disclosure, I also pay for The Guardian (which doesn't have a paywall) and support a number of blogs.
PS - Any time you write "in pursuit of their traditional margins" you're probably writing about an industry that will never get them back.
Today's malvertising story comes from Kaspersky Labs:
ReplyDelete"By simply viewing their favorite news sites over their morning coffee users can end up downloading last-browser-update.apk, a banking Trojan detected by Kaspersky Lab solutions as Trojan-Banker.AndroidOS.Svpeng.q. There you are, minding your own business, reading the news and BOOM! – no additional clicks or following links required. And be careful – it’s still out there!
It turns out the malicious program is downloaded via the Google AdSense advertising network."
Doc Searls has a great rant about how counter-productive it is for companies, especially Amazon, to bombard you with ads for the product you just purchased.
ReplyDeleteAhem!
ReplyDelete"Hackers thought to be working for Russian intelligence have carried out a series of cyber breaches targeting reporters at the New York Times and other US news organizations, according to US officials briefed on the matter."
Via Yves Smith at naked capitalism, a look at the declining revenues of newspapers, and the effects of the decline:
ReplyDelete"a reduction in advertising revenues will reduce the quality of newspapers. Ultimately, this may result in a less well-informed public.
The year 2015 was perhaps the worst for the newspaper industry since the recession. According to the Pew Research Center (2016), in the US total advertising revenues (print and digital) among publicly traded companies declined by nearly 8%."
Doc Searl's It’s People vs. Advertising, not Publishers vs. Adblockers makes a good point:
ReplyDelete"nearly all press coverage of what’s going on here defaults to “(name of publisher or website here) vs. ad blockers.”
This misdirects attention away from what is actually going on: people making choices in the open market to protect themselves from intrusions they do not want.
Ad blocking and tracking protection are effects, not causes. Blame for them should not go to the people protecting themselves, or to those providing them with means for protection, but to the sources and agents of harm."
At Techdirt, Leigh Beadon sums up the state of Internet advertising with Traffic Is Fake, Audience Numbers Are Garbage, And Nobody Knows How Many People See Anything. The headline sums it up.
ReplyDeleteOn Digby's awesome blog, the equally awesome Spocko extends this to Twitter with On Debate Night Your Tweet Matters. A sample:
"But you know whose tweets will get picked up? The millions of TwitterBots controlled by a handful of people. They know how the keywords, counting and sorting tools of the media work. This means that when the media talks about "the public's reaction" It's not totally the public's reaction. This is a problem. How big is it?
One estimate from Twitter Audit is that 1 out of every 4 followers of Big Orange Hair are fake. And yes, both sides do it, Hillary Clinton has the same percentage of fake twitter followers as her opponent. You can be outraged or see it as "Bot Parity" for those accounts."
Spotify joins the ranks of major malvertising sites.
ReplyDeleteIn Millions exposed to malvertising that hid attack code in banner pixels, Dan Gooding reports that:
ReplyDelete"Millions of people visiting mainstream websites over the past two months have been exposed to a novel form of malicious ads that embed attack code in individual pixels of the banners. ... The malicious script is concealed in the alpha channel that defines the transparency of pixels, ... To execute the hidden payload, the malicious ads load a heavily modified version of Countly, an open-source package for measuring website traffic. That JavaScript extracts the hidden code out of the image and executes it. Because there's nothing per se malicious in the JavaScript, ad networks fail to detect what's happening."
The campaign is very successful:
"We can say that even some of the other major exploit kits, like Angler and Neutrino, are outclassed by the Stegano kit in terms of referrals—the websites onto which they managed to get the malicious banners installed," Eset researchers wrote in a report published Tuesday. "We have observed major domains, including news websites visited by millions of people every day, acting as 'referrers' hosting these advertisements."
Atrios agrees with me.
ReplyDeleteWalt Mossberg is annoyed by the ads but he clearly doesn't understand the scope of the problem. They aren't just annoying, they are dangerous.
ReplyDeleteGoogle just discovered and banned a massive Android malvertising family:
ReplyDelete"Dubbed Chamois, the family of PHAs (potentially harmful applications) was capable of bombarding users with pop-up ads, boosting app promotion by automatically installing other applications in the background, subscribing users to premium services by sending text messages and downloading additional plugins without their knowledge."
At last, someone else has noticed that re-laying out the content while someone is reading it is an awesomely sucky idea. In a signature rant, the redoubtable Dabbsy (Alistair Dabbs) at The Register asks Why do GUIs jump around like a demented terrier while starting up? Am I on my own?. As with any good rant, extracting quotes is value-subtracting, but here is a taste:
ReplyDelete"This leaves you chasing after buttons and tabs as they slide around, jump up and down, run about in circles and generally act like some demented terrier that has just dug up a stash of cocaine-laced Bonio.
I blame web browser developers for letting this happen. Allowing websites to load into a browser window bit by bit was a mistake. Over the years, this has persuaded application developers into thinking this is acceptable behaviour when IT ISN’T."
and:
"You trigger a lengthy process such as a network install and send it behind your other software while you carry on working. Seven hours later, when it has nearly completed, the long process jumps to the front without warning, overlaying your current application’s Save button that you chose that moment to click on with another labelled Cancel Install."
No, Dabbsy, you aren't on your own.
At last Google has done something about the way pages leap about like a demented terrier. "Scroll anchoring" is now on by default in Chrome 56+.
ReplyDeleteWeb advertising has officially jumped the shark. Procter and Gamble, the world's biggest advertiser, cut spending on digital ads:
ReplyDelete"[P&G cut spending] by an amount equating to $140mm. For context, P&G spent $7.2bn on advertising during its fiscal 2015, and likely around $1.5bn in digital advertising, or ~$400mm per quarter. An advertiser like P&G might allocate around 70% of digital advertising budgets to Google and Facebook ($300mm?). P&G’s prior rhetoric regarding Facebook and Google (and crude math, given the scale of the cuts) strongly suggest that these media owners would have experienced cuts."
And nothing bad happened to P&G:
"Most critically, because P&G indicated its view that reductions did not impact revenue growth, the statement will undoubtedly add fuel to the fire of large brands more carefully scrutinizing their digital advertising choices. Large advertisers represent around 30% of Facebook revenues, on our estimates."
Tyler Durden reports that it isn't just P&G:
ReplyDelete"Restoration Hardware delightfully colorful CEO, Gary Friedman, divulged the following striking anecdote about the company's online marketing strategy, and the state of online ad spending in general (courtesy of @parsimony16). What Friedman revealed - in brief - was the following: "we've found out that 98% of our business was coming from 22 words. So, wait, we're buying 3,200 words and 98% of the business is coming from 22 words. What are the 22 words? And they said, well, it's the word Restoration Hardware and the 21 ways to spell it wrong, okay?"
Stated simply, the vast, vast majority of online ad spending is wasted, chasing clicks that simply are not there."
Click through to read the full details. Online advertising has indeed jumped the shark.
More evidence for the shark-jumped nature of Web advertising from Ad Age:
ReplyDelete"Methbot, a domain spoofing scam that's widely regarded as the largest ad fraud attack in history, bilked marketers of $3 million to $5 million a day for over a month. Even Google, which is regarded as having the best defenses when it comes to preventing fraud, is also believed to be a victim of a recent domain spoofing attack."
I've just had another sub-optimal user experience with the New York Times. I was reading their "interactive" on Alaska's National Petroleum Reserve using Firefox on Linux Mint when my hotel's flaky WiFi kicked me off. The mouse froze, my entire UI froze, and my only recourse was to power-cycle my laptop. Thank you for an "interactive" experience!
ReplyDelete