Algorithmically Assisted Editorial Insight for Professional Publishers

John Barker
Written by John Barker
on August 03, 2012

Publishers of professional content have a significant advantage over public search engines. As I’ve noted in the past, professional publishers do more than merely index content for a search engine. Professional human editors – often with the same degrees and credentials as the practitioners who rely on them – summarize, explain, link and topically classify content. Editors who are lawyers and accountants synthesize concepts from multiple sources of law into actionable content for lawyers and accountants, who further contextualize that content to resolve their client’s issues. Editors who are physicians – many still practice medicine – synthesize findings from clinical trials and review thousands of articles in medical literature. Practicing physicians rely on the physician-editors’ insights to generate better patient outcomes as part of evidence-based medicine.

Professional customers simply cannot keep up with the stream of content. Public search engines, despite sophisticated relevance-ranking algorithms, still present answer sets of thousands and hundreds of thousands of documents. The flood of content is only going to get bigger. It is harder for editors to keep up with the flood. This is where automation and algorithms can step in. Computer-assisted content enrichment is far more sophisticated than it used to be. Computers can literally write the news when the content is predictable. Citations to primary sources of law in content can be automatically transformed to active hypertext links. Algorithms can summarize documents, thus making it easier for editors to determine the most important points in a document. That summary might not be readable, but it might give an editor a head start in creating a meaningful summary that is meaningful to professional customers. Algorithms can topically classify documents and document fragments. That topical classification can be used for browsing, searching, linking and relevance ranking. Again, the topics assigned by algorithms might not reach the level of precision needed by professional customers, but it can be used to route content to editors and speed up the process for them to assign a more precise topical classification.

I still do not see algorithms replacing editors. But there is an interesting possibility with “low value” content. For example, officially unpublished opinions do not have precedential value. The volume of these opinions is high. Human editors cannot invest valuable resources in summarizing those opinions compared to appellate court opinions. This is an example where automated methods might be sufficient for a customer’s research needs. Of course, automated content enrichment methods could be used to identify for editors those officially unpublished decisions that might be of particular interest. Closer attention is needed into the value of each type of content for professional customers and what combination of human and algorithmic enhancements are necessary to make it actionable.

I am convinced that professional publishers must strike a balance between applying algorithms and editors to content. What is clear is that technology is advancing and what tasks are delegated to computers versus editors will always be in flux. Any thoughts?

Tags for this article: , ,


Comments

There have been made 5 comments on this article

  1. Angel Sancho Ferrer on August 3rd 2012 at 01:57 pm

    The technology is demonstrating that has the capability, as you mention, of automate some pattern recognition, or at least produce drafts to be validated by experts (as in a pyramidal organization).
    But also analytical tools are common in scenarios as scientific research where there is so much data than can be never looked at it directly, and need these kinds of computer assisted filter and interpretation.

  2. Fred Zimmerman on August 15th 2012 at 01:10 am
  3. DIGEST: Are Algorithms the Answer? on August 30th 2012 at 03:16 pm

    [...] Staff Reporter on August 30, 2012 John Barker over at Wolters Kluwer Intelligent Solutions Blog has a pretty interesting piece on “Algorithmically Assisted Editorial Insight for Professional [...]

  4. [...] hat tip to the Jones McClure Publishing blog, Annotations, for pointing out John Barker's post on "Algorithmically Assisted Editorial Insight for Professional Publishers." In it, Barker discusses the well established notion that there is just too much information out [...]

  5. [...] on September 6, 2012 Last Thursday, we published a digest about a piece by John Barker at Wolters Kluwer Intelligent Solutions Blog discussing algorithmic assistance for editors. Rod Friedmann over at Prism Legal has written an [...]

Leave a comment

Exploring content, technology, & new ideas in the global information industry. New posts every Monday, Wednesday, Friday, & sometimes more. Visit us also at www.wolterskluwer.com
Recent comments
dropdown