Legal Technology News - E-Discovery and Compliance Blog

« February 2013 | Main

March 2013

March 12, 2013

EDI-Oracle Study Update

It has been a few weeks since our last update. We have extended the time to respond for the participants. While some thought the extension was unfair to those that have submitted on or before the due date, Pallab, the professors, and I all want as many data points as possible in the evaluation. That said, we are taking note of those teams that submitted early.

Again, we should remind all participants that time is one of the factors in the subsequent evaluation by Oracle. Therefore, a quicker turnaround is preferable and no participant should withhold submitting results unless the additional time is required to complete the review. While there is no penalty for submitting after the first deadline, Oracle will look favorably upon those that finish quickly.

Also, if there were tasks required by the protocol that your firm would not have normally undertaken in a real-life review (categorizing privilege for NR docs), please identify that task as a break-out on your model invoices with an explanation. You may submit your model invoices at you leisure, but no later than May 1.

Best,

Patrick

March 04, 2013

Search Software: 25 Things to Consider

4-levels-pyramid Selection of advanced TAR or CAR-based type search and review software is not an easy decision.

I had a chance recently to study the private manuscript of Professor Doug Oard on search design, Information Retrieval for E-Discovery. He is one of, if not the top independent expert on search in the world today. His manuscript written with William Webber is a survey that will be used to teach the next generation of information retrieval engineers, the ones who will help design the legal search software of the future.

Doug was also kind enough to try to explain key portions of this manuscript to me. The end result is a rather complex and lengthy blog entitled The Many Types of Legal Search Software in the CAR Market Today. Here is my takeaway list of twenty-five plus factors you should consider to evaluate the strength of search software. They should help you to evaluate the overall quality, effectiveness, and efficiency of the software on the market today.

  1. Search of content.
  2. Search of contextual metadata.
  3. Search of descriptive metadata.
  4. Search of behavioral metadata.
  5. Classifier design.
  6. Active query formulation features (building blocks).
  7. Annotated example training features (pearl growing).
  8. Random training abilities.
  9. Human judgment training features.
  10. Software uncertainty selected training.
  11. Balance in your classifier system between complexity and intuitiveness.
  12. Deduplication, near deduplication, and similarity searches.
  13. Concept searches, what exactly are they doing and how.
  14. Clustering features.
  15. Email thread and families.
  16. Quality control features.
  17. Quality assurance features.
  18. Confidentiality protection features, including privilege logging and redacting.
  19. Recommended method(s) of use (level four).
  20. Ease of operation.
  21. Clarity and efficiency of user interface.
  22. Customizability for particular licensees, projects, users.
  23. Response time (each entry and length of search processing).
  24. Reporting capacities and usefulness.
  25. Expense.

There are many other criteria, I know, such as information security, more specific user interface issues, reviewer and production issues, reviewer monitoring and interface, online access, etc. Software selection should also carefully consider the software support and training issues. Project management support is also critical, some say just as important as the software itself, especially for novice users of the search software.

Sign Up for the E-Discovery and Compliance Newsletter

An Affiliate of the Law.com Network

From the Law.com Newswire

Sign up to receive Legal Blog Watch by email
View a Sample



Contact EDD Update


Subscribe to this blog's feed



RSS Feed: LTN Podcast

Monica Bay's Law Technology Now Podcasts are also available as an RSS feed.

Go to RSS Subscribe page




March 2013

Sun Mon Tue Wed Thu Fri Sat
          1 2
3 4 5 6 7 8 9
10 11 12 13 14 15 16
17 18 19 20 21 22 23
24 25 26 27 28 29 30
31            

Blog Directory - Blogged