Download Ebook

After the breakout success of Fifty Shades of Grey, there was a surge in copycats, and the industry seems to be suffering from overload.

Agent Ginger Clark tweeted from the Frankfurt Book Fair that she was seeing a lot of "erotica fatigue" in traditional publishing.

2) The Global Marketplace

As we reported here last month, the marketplace for ebooks is now global, and as Smashwords' Mark Coker says, "Major retailers set their sights on a global market where the cultural, religious or political norms in some countries will find certain categories of erotica too objectionable."

3) Apple has No Erotica Category

More and more people read books on their iPads and iPhones, but Apple steers clear of anything that could be called porn. Perhaps with the global market in mind, the Apple store banned hard-core erotica over a year ago. The heavy-handed purge removed entire publisher accounts from the site because of a few offending titles. 

Beginning last spring, Amazon, too, has sought to rein in the hard core stuff. It has created an "adult filter" that has been separating erotica from other books for suggestions and also-boughts. Authors find when they're put in this "erotica ghetto" it greatly reduces their sales.

5) No Sex, Please, We're British

In July of this year, the UK's Conservative government announced a "war on porn" that among other things, requires "family friendly" filters on computers and has made it illegal to possess material depicting rape.

6) The UK Tabloids' "Epidemic of Filth" Brouhaha

Worries about "An Epidemic of Filth" in the book industry escalated a couple of weeks ago, when UK tabloids brought up the problem of unvetted self-published porn, which can veer into illegal territory. The Daily Mail used it as an excuse for an anti-Amazon diatribe and the online magazine, The Kernel attacked even venerable UK retailers like W. H. Smith, Foyles and Waterstones. 

Of course there's a lot of traditionally published erotica that gets into the wrong searches, too. But the tabloids chose some particularly vile examples of illegal porn that was self-published or put together by low-rent marketing companies, and people were disgusted.

Amazon simply removed the offending books immediately.

W. H. Smith, however, "solved" the problem by shutting down their entire website and not going back online until they had removed ALL self-published and small press books. Permanently.

Kobo, the mega-retailer that supplies W. H. Smith and many other bookstores worldwide, followed suit and removed all indie books from their UK site.  Kobo has since returned most of the books. They seem to have worked out an algorithm like the ones at Amazon and Smashwords to filter offending books. If your book hasn't been returned, you can contact them at writinglife@kobo.com

Although the handful of books presented in the complaints were obviously offensive and illegal, the nuclear response sent a chill through the industry. You can read indie author Michelle Fox's take on the whole mess at the Indie Reader.

As Ms. Fox points out, aside from the question of censorship, the big problem is that algorithms are never 100% accurate. In fact, she reports some of the "offending books" mentioned in the Daily Mail article  weren't offensive at all.

She says Amazon's erotica filter sometimes labels a book cover as porn just because it has a face on it. It seems the algo measures pixels of skin tones, so a baby's face will show as large a percentage of skin as hard core porn and can be labeled as such. And I've also heard that Amazon's algo originally put Fifty Shades of Grey into "Christian fiction" because the protagonist's name is "Christian". That may be an urban legend, but anybody who's received Amazon's title suggestions knows they often get things comically wrong.

Amazon's algos are constantly being revised and updated. They may get more restrictive following the recent bad press. 

Smashwords' Mark Coker thinks they will.

Mr. Coker said this on his blog on October 15th: "Smashwords erotica authors can now assume that erotic fiction where the predominant theme, focus, title, cover image or book description is targeted at readers who seek erotic stories of incest, pseudo-incest or rape will find that their content is not welcome at the Kobo store. I've heard multiple reports that Amazon is cracking down on the same." 

Smashwords was one of the first retailers to deal with the erotica filtering problem, when PayPal refused to deal with them unless they censored hard-core erotica. Erotica was banned for several weeks in 2012 until Mark Coker installed a new filter and made a deal with PayPal, so they're now ahead of the game.

Now it seems the Smashwords filter developed for PayPal isn't restrictive enough for Kobo and Apple, so Coker is working on a "two tier" system for erotica.

He says: "Smashwords is considering adding new metadata fields for erotica authors so they can voluntarily tag their books as NSFAK (not safe for Apple/Kobo), but because these titles meet the Smashwords Terms of Service they are allowed at Smashwords and other Smashwords retailers. This will allow us to omit certain books from certain distribution channels while maintaining the flow to the Smashwords store and others."

There's no question that some filtering was needed. Parents were understandably freaked when their kids got suggestions to read wildly inappropriate books. And not every adult is into kink. The "romance" category is a huge umbrella these days, and cover images can be pretty shocking to people who aren't used to looking at contemporary erotica.

But because the filtering is done by robots, a lot of mistakes happen. And the algos are secret, so nobody knows what words and images will tag your book as porn.

If you write erotica and want to know what might trigger the algos, there's a breakdown here at Smutwriters.

But what if you don't write erotica? It's bad enough for an erotic book to be shifted off to an "adult" section, but if your novel only has a few sex scenes, erotica buyers will think it's totally lame, but nobody else will see it.

This means that being flagged for adult content could kill your book dead.

That's why publishers like mine figure it's better to be safe than sorry. If you can tell your story without explicit language and descriptions of body parts, you might consider leaving them out, since those are most likely to trigger the algos.

I've deleted "f" bombs as well as explicit scenes from my new novel. It was too long anyway, and I don't think the story loses anything.

But does this herald a return to the Puritanism that banned books like Lady Chatterley's Lover and Lolita? Are we going to return to something like the Hays Code and let algorithms become the new Catholic Legion of Decency?

I don't think so.  

Michael Tamblyn at Kobo wrote in the Writing Life on October 25, "Many of our readers have no problem with an erotic title in their library next to their romance, literary fiction, investing or high-energy physics books. And we are here for the readers, so erotica stays, a small but interesting part of a multi-million-title catalogue, in all of its grey-shaded glory."

But in the digital age this venerable type of formula has taken on a huge importance for the marketplace. An algorithm can make or break sales of any product online. As superstar author Hugh Howey said in an interview on Reddit, “I'm guessing 90% of my sales are from reader recommendations and Amazon algorithms.”

Or as his interviewer called them "the inscrutable Amazon algos."

They're sure not scrutable to me. I'm pretty sure they have to do with math, at which I suck. Seriously. I had to be counseled for “math anxiety” in high school.

Besides, algorithms aren’t that easy to define—even for the people who work with them. The Wikipedia article says, “While there is no generally accepted formal definition of 'algorithm,' an informal definition could be 'a set of rules that precisely defines a sequence of operations.' For some people, a program is only an algorithm if it stops eventually; for others, a program is only an algorithm if it stops before a given number of calculation steps”

Yeah, right. If you’re like me, your eyes have started to glaze over already. Secretly, I think of them as little robot elves who get things done inside my computer.

Like bringing up 64,300,000 links in .52 seconds when you put the word “algorithm” into Google’s search window.

Pretty durn clever, these elves. And kind of Big Brothery. They're what Facebook uses to analyze your “Likes” and figure out if you’re gay, conservative and/or smart.

They’re not infallible. They're responsible for sending you those emails from Amazon suggesting you buy or review your own book, and they're the reason you got spammed with dozens of ads for refrigerators after you accidently Googled “fridge” instead of “fudge” last week.

But they work well enough that businesses increasingly depend on them. A new online lingerie retailer, True&Co, uses a questionnaire and an algorithm to sell mail-order bras—a product that’s difficult to fit even in real-life dressing rooms. According to the NYT, at True&Co “women end up buying more of the bras chosen by the algorithm than the ones they select themselves.”

As you might imagine, online book retailers depend heavily on algorithms to get books in front of the people who might buy them.

David Gaughran talked about the complexity of Amazon’s algorithms in making Amazon’s bestseller lists on his blog, Let’s Get Digital.

“Amazon has a bevy of Bestseller Lists, all split into Free and Paid listings. The big one is theTop 100 in the Kindle Store, and placement on this list can drive staggering amounts of sales. This list is populated with items ranked #1 to #100 in the overall Kindle Store, which includes not just e-books, but also things like games, magazines, and newspapers.

The exact algorithm Amazon uses to assign a Sales Rank to each book is a closely-guarded secret, but the general make-up is easy to deduce. Simply put, your Sales Rank tells you how many books are selling more than you at this moment in time (it’s updated hourly). However, it also takes account of historical sales. More recent sales are weighted much more heavily in the algorithm, though, and velocity plays a big part too (how much your sales are increasing at that moment in time). There’s a lot more to it, but those are the basics.”

David talks more about how Amazon’s algorithm-driven recommendation engines work in a post from February 2013.

But the most important thing to know about the algorithms book retailers use is that they CHANGE. Those robot elves are programmed by real people—who are constantly inputting new data.

Mark Coker changed algorithms at Smashwords last year to encourage authors to stop devaluing their work by giving away so many free books.

Mr. Coker said, “At Smashwords, up until January of this year [2012], our algorithm for best sellers just looked at absolute downloads, but authors gamed that system by offering discounted or free books using the Smashwords coupon tool. So we changed our algorithm to focus on gross sales, so now when you look at the Smashwords best seller list, you’re looking at absolute dollar sales, which we are using as a representation of the interest of customers.”

Amazon changes its algorithms more often than Smashwords. Which means a whole lot of the “rules” you hear about how to sell big on Amazon are based on algorithms that no longer exist.

If you're in the indie author scene, you've no doubt heard a ton of rumors about what the Amazon algorithms will reward or penalize. You’ll hear that more than 50—or 100—“likes” will get more recommendations, or any 3-star or lower reviews will exclude you from the also-boughts or downgrade your author rank. Or that uploading from a non-US country downgrades your status, or dissing Amazon in their forums will be reflected in your sales ranking. Some of these may be true or may have once been true, but they’re hard to prove. And trying to game them generally isn't a good idea.

That's because the one thing we do know for sure about algorithms is that Amazon does not like it when you try to game them.

Which is probably why the Zon is removing the “like” buttons and “tags” on US buy pages. Every author group I belong to asks people to “like and tag” each other’s book pages whether or not the books are in a genre you read or enjoy. Which means the “likes and tags” no longer have meaning for tracking a person's individual preferences, which was the point in the first place.

Even though nobody can know for sure how the “inscrutable algos” are programmed, Amazon watchers can tell when there’s been a change. Some people make a serious study of them.

With the advent of KDP Select—Amazon’s program for books they have exclusive rights to sell—the algorithms were changed to benefit Select members. Select books get more weight in the popularity lists, more suggestions for “also bought” books, e-mail recommendations, and are featured when somebody searches the genre. That makes sense. When you ask for an exclusive, you need to give perks.

Now there’s an even more privileged “White Glove” program for books that have been “self-published” through a literary agency. It has a longer exclusive period and gets the benefit of even more also-boughts and other promotions.

Nothing wrong with that. It’s Amazon’s store and they can promote what they want. But it does make it harder on the truly self-published and small-press competition.

The “Kindle Revolution” that Amazon sparked in 2009 allowed individual authors to self-publish cheaply and gave them an equal opportunity with big publishing’s authors to get discovered. This was a brilliant way of providing a lot of inexpensive books for their brand new Kindle at a time when most people didn’t even think they needed an ereading device.

It was win/win. Amazon sold Kindles—and individual authors got to enter a marketplace that had been reserved for big corporations for half a century.

In doing that, Amazon shook up the book world and did a service to new authors that was pretty unprecedented.

But since then, Amazon has become a publishing company itself. Their Thomas and Mercer, 47North, Montlake Romance, and other imprints now compete with the Big 5. They also compete with the indies. Guess who the algorithms are likely to favor? (I did mention the elves are smart?)

Meanwhile, Amazon's competition as a retailer continues to grow. Kobo and Apple are gobbling up market share. Like any big business, the Zon wants to dominate the competition and keep its place as Alpha Dog of the online retail business.

So they’ve made it very appealing for authors to sell exclusively through them—both with their KDP Select and White Glove program.

And last month they bought Goodreads. We still have to see how that will affect self-and small-publishers. David Gaughran thinks it’s a boon to authors. But some others, like Jarek Steele, and The Author's Guild —not so much. But Mr. Coker saw a silver lining: a way of thwarting people who try to manipulate the elves with paid reviews. For a nice, balanced overview of the argument, read Porter Anderson's piece in Ether for Authors at Publishing Perspectives.

The one thing people agree on is that Amazon wanted Goodreads' data to feed its algorithms. As Gaughran says “Amazon’s recommendation algorithms will be vastly improved with all the data that Goodreads has been collecting.”

So is it true that the Amazon algorithm elves are no longer friendly to indies? Do they only like you if you publish through them, or have an agent—or at least give them an exclusive?

I think it's clear that multi-platform indies are not in the Zon's A-list any more.  I’m not sure we’ll see as many 100% self-pubbed authors reach the heights that Amanda Hocking and John Locke did in the heady early days of the "Kindle" revolution. But indie books by previously traditionally-published hybrid authors are still breaking records. And agents are still trolling the Amazon bestseller lists.

Indies are also hurt by the Big Six books that are being offered as cheaply as indies. (There have been amazing giveaways of big name author’s books, especially in the UK. And this week I saw Barbara Kingslover's iconic novel The Bean Trees for $1.99)

Some people think this all means that the self-publishing revolution is dying.

But the fact is, the trend to self-publishing and boutique digital press publishing is not only alive and well, but growing.

This is because Big Publishing has done nothing to change their attitude that the publisher/author relationship must be one of master/slave. They have made themselves less attractive to new writers with ever more draconian contracts and demands that authors hire publicists and provide expensive traditional marketing with their own funds while the publisher risks nothing, sometimes offering no advance.

The fact that Amazon aspires to become a big publisher itself may make Amazon less attractive for the truly independent author.

But the door to successful self-publishing has been opened and it’s not going to close. The Zon may no longer be the fairy godperson of indie self-publishers, but it's not the Great Satan, either.

And more important:  it's not the only game in town. Amazon now represents less than 50% of the ebook market.

• A huge number of readers prefer to read on their iPads, which makes the Apple store a big contender.
• 50% of Apple ebook sales are outside of the US, where the Zon is not always revered, due to a habit of tax dodging. 
• Kobo has a growing share of the international market, plus Kobo ereaders are selling in indie bookstores, which gives indie authors a chance to reach readers through old-time word-of-mouth, in-store promoting. 
• The moribund Barnes and Noble/Nook store is undergoing a major overhaul with the new Nook publishing. Those who fear change say it's a disaster, but many in the know say it's much more user friendly and heralds new and forward thinking from Nook, which is still a player in the ereader market. 
• Plucky little Smashwords is expanding all the time. They are the only way for non-US writers to get uploaded to region-specific sites like Barnes and Noble, so they are becoming more and more useful to indies all over the world. 

Self-and small press published authors who want to be on top of the next trend need to spread their marketing to all platforms, instead of spending all their time courting the Amazon algorithms with freebies and/or organizing armies of fellow authors to give likes and tags and fake reviews.

Launching a book in Amazon's Select program still seems to be a good move. (It works for me, anyway) but after the first three to six months I think most writers need to spread out to other platforms and promote there.

What we do not want to do is keep repeating what worked when the algorithms were the BFFs of the indie authorpreneur and the word "Kindle" was synonymous with "ereader".

The  Indie "Kindle" Revolution may be fading, but the Indie Digital Revolution is still in a dynamic and robust infancy.

What about you, scriveners? Have your sales been affected by the changes in algorithms? Have you heard rumors that you need to do certain things to keep on the good side of the Zon elves? Do you miss the "likes" and "tags"? Do you fear the indie revolution is petering out? 

UPDATE: There is now an algorithm that writes poetry. See, I said those elves are smart! The New York Times now has a Tumbr site where they post algorithm-written haikus based on news stories, called Times Haiku. Here's my favorite. (From an article on Margaret Thatcher's legacy.)


OPPORTUNITY ALERTS:

1) Readwave: A showcase for short stories: ReadWave is a community of readers and writers who love to discover and share new stories from contemporary writers. Readers can access thousands of stories and read them for free on mobile or desktop--and writers can use ReadWave to build up a fanbase and market their stories online. ReadWave has created a new reading widget, that allows bloggers and website owners to embed stories online in a compact form. The ReadWave widget is the first reading widget to allow readers to "follow" the writer. When a reader follows a writer they are added to the writer’s fanbase and can receive updates on all of the writer’s future stories. ReadWave puts writers in touch with the readers that are right for them. This looks like a great innovative site. You know how I've been encouraging you to write more short fiction? This is where to put it to start building a fan base.

2) The Saturday Evening Post’s Second Annual Great American Fiction Contest—yes, THAT Saturday Evening Post is holding a short fiction contest. Could you join the likes of F. Scott Fitzgerald; William Faulkner; Kurt Vonnegut, Jr.; Ray Bradbury; Louis L’Amour; Sinclair Lewis; Jack London; and Edgar Allan Poe? $10 entry fee Deadline July 1, 2013