Monday, July 26, 2010

Brainbolt



The geek in me gets a hold of my brain sometimes, and when it does, that can be as fun as writing.

Here's what I've been thinking about recently: Publishing is a stochastic process.

Okay, I'll back up.

In physics, when you've got a large system comprised of small bodies, and you can predict what the system as a whole will do but not what one individual body will do, that's a stochastic process.

An example of this is a gas comprised of molecules. Imagine you compress the gas into a smaller volume. What will one individual molecule do? You can't say. It might collide with another molecule. It might move up or down or to the left or it might stay still. It might rotate, for heaven's sake.

But the gas--you can say things about the gas as a whole. You can say that its temperature and pressure will increase.

Publishing is a stochastic process. You can't say with any accuracy what one random person wandering through a bookstore will or won't buy. You might, however, be able to predict roughly how many copies of one particular book will sell to the whole population of random people wandering through bookstores.

What makes publishing such a dangerous occupation is they have to make these kinds of predictions all the time, and if they screw up--even on just one book a year--they stand to lose a lot of money. Too large a print run can devastate the company's bottom line; too small a run can let a potential bestseller slip into oblivion.

Now here's the thing: Physicists get hired by financial companies to mathematically model the stock market. These physicists occasionally can come up with better predictions for what's going to happen than the guesswork of savvy and experienced professionals is able to provide. And even a tiny edge can turn into massive profits when it comes to something as variable as the stock market.

So this makes me wonder if anyone's ever tried to mathematically model book sales, i.e. tried to predict the rate at which something will sell initially and how word-of-mouth will affect its sales. Anything that keeps those few, disastrous screw-ups from happening could make a huge difference to the publishing industry.

I've thought about the problem a bit. It could be done, but you'd need some input parameters that you could only get by quizzing readers (about 30 to get a statistically valid sample) who are the sort of person who'd potentially buy that kind of book.

You'd need to ask them how well the cover, blurb, and sample page draws them in (i.e. convinces them to buy the book), then quiz them again after they've read the book regarding whether they liked/hated it enough to mention that fact to a friend or two.

And that's the tricky part, because while publishers would be the most benefited by having access to the modelled data, an internet-based book seller (particularly one with a mighty database like Amazon has) would be better equipped to do the initial study. They could offer incentives to readers in order to get feedback on a new book.

Me and my rusty memory of statistical physics are still working on the model, but just think how freeing it would be to the publishing industry if they could get a system in place that helped them avoid those few, but appallingly costly, mis-steps that plague their profit margin.

Also consider how it might help quirky authors find their market; if the publisher could predict how many copies of a particularly oddball novel it can sell (via booksellers), then they could adjust their print runs to make a profit on even on less commercial books.

~~~~~~~

What do you think? Have you heard of this being done already? (If there's money at stake, surely someone's taken a stab at it...) Do you think it's possible to pin down something as variable and unpredictable as individual taste and the zeitgeist of the public?

What input parameters do you think such a model would need? I've thought about author brand, enticement of title, pretty covers, prominence of bookstore placement, word-of-mouth, etc. etc...


Author website: J. J. DeBenedictis

7 comments:

fairyhedgehog said...

That's some pretty deep thinking going on there. I don't know enough about either publishing or physics to contribute anything useful!

Love the tee shirt.

Kate said...

Interesting. I apologize right now for the ramble you've inspired:

I studied stochastics in college as part of my systems analysis degree. Stochastic prediction models require probabilities first be assigned to the outcomes of the various events in the system. This can work well for physics, or a manufacturing facility, or lines at Disney World, where you can observe a controlled system over time.

Market research for a future product is a little different. Yes, you can use focus groups to figure out some probabilities of specific sales and recommendations, but you have to combine those with predictions regarding competitive factors (what else is going to be released that week?), localized market conditions (the unemployment rate for your target market in various regions?), the probability of some other even changing everything (a hurricane/terrorist attack/authors' arrest...), etc. etc. Meanwhile you are tweaking your product and marketing plan based on your focus group feedback. You may end up having to make so many assumptions that the output becomes no more reliable than a professional's guess in the first place. And don't forget that all this research and modeling is expensive!

Also, using a focus group means you have to actually create the book in the first place. Although good sales predictions can help you optimize printing and promotional return-on-investment, this is apparently not the lion's share of the cost of an average book (based on a Nathan Bransford blog post comparing publisher's e-book vs p-book costs.)

I have no doubt there is room for improvement in whatever models publishers use, but I'm equally sure that stinkers will inevitably sneak through.

You know, I also think that sometimes publishing execs just *need* to bet the farm on a book; sometimes in business you need a win so bad that a big loss is no worse than squeaking by. In fact, sometimes it's better.

jjdebenedictis said...

FairyHedgehog: I am embarrassed to say I would totally wear that tshirt! (And mortify my husband in the process.)

Kate: Hey, awesome thoughts, Kate!

The points you bring up are part of why I think publishing would be a good target for this kind of modelling.

With novels at least, every book is unique and thus a distinct product and competition becomes less of a concern. If Stephen King and Joe Nobody both write a book about werewolves, they're not really competing with one another. Stephen King's draw might help the book by Mr. Nobody sell, or it might undermine it, or it might have no impact at all.

And if Joe Nobody writes a stinky book about werewolves and Jane Nobody writes a fantastic one, the bad book won't sell well and the good one will. It's all so...orthogonal. You can probably make decent predictions just based on how people react to the words on the page.

You're right that paying talented people is the real cost in publishing, but given how publishing houses depend on a few bestsellers to subsidize all their other books, I still think cutting down on the number of expensive errors could help them a lot.

As for someone betting the farm on one book--yeah, some people just have to gamble. The stock market operates the same way, but the people who try to not gamble tend to do better in the long run.

Erica Orloff said...

Well . . . if you look at The Tipping Point, he tries to elucidate how many online friend you have to have in order to "go viral."

E

Travis Erwin said...

Interesting and definitely something to ponder.

writtenwyrdd said...

Interesting thinking there. I'm no mathematician, but I presume you'd have to define the parameters (such as what quantity is word of mouth and other such ephemeral factors) in order to work the equations?

So I think some further modeling of the book selling and advertising markets would be in order. (If publishing had more money to invest, they might front the research. But they don't have investors like, say, pharmaceutical firms or software companies, who are willing to J.V.)

jjdebenedictis said...

Sarah: Yeah, you'd need to do some studies (maybe on books that have already sold, so you could correlate it with sales) to determine whether you can map word-of-mouth against a book's success.

The geek in me would love to do this on the cheap, just for the interest factor, but I have a day job! (Not to mention books I should be writing...)

Pageloads since 01/01/2009: