To remove the responsibility of marking documents for online learning from the Validation user, create a script that evaluates a document and marks it for extraction online learning.

Creating a script for this purpose is similar to automatically marking a document for extraction online learning.

Also use scripting to remove the buttons from the Validation toolbar if documents are being flagged automatically.

See the Scripting Help for more information about the script events that you can use for online learning.