Product Release Notes

2022-11-29 3.0.3041

  • Class name error message fixed: Class names must start with an uppercase letter, only contain alphanumerical characters or '_', and not exceed 32 characters.
  • Fix issue where suggestions in Co-Pilot would occasionally appear twice.

2022-11-11 3.0.2940

  • Dataset enrichment is now live in the SDK! Now you can enrich your dataset with valuable attributes in a hosted Watchful instance. Refer to the enrichment readme for more information.
  • Truncate columns in hand label history
  • Land Standard and Admin users on the Query page when opening a project
  • Rearrange charts so Confusion Index is at the top

2022-10-19 3.0.2816

  • Fix crash in suggestion engine from looking up deleted hinter
  • Fix performance issue with projects that have thousands of hand labels
  • Fix UI component misalignment

2022-10-13 Watchful Python SDK

We've released our public Python SDK! Check it out here and make sure to read through the introduction here.

2022-10-04 3.0.2724

  • Update the titles used in Co-Pilot
  • Redirect User to Account Screen on Login/Register
  • Redirect New Users to Login Screen - Hub
  • Add pending user login screen message
  • Fix skip hot key error
  • Remove Versions page in Hub
  • Fix: land user in co-pilot when opening a project

2022-09-27 3.0.2633

  • Fix export button
    • Make the export button actually download a file
    • Export the correct class type based on what the user's selected
  • Introduced Notification Center
    • The Notification Center will report Notification Events in the system. Examples of Notification Events include, but are not limited to: Hinter Reviews and Hand Label Disagreements
  • Fixed hand labels made via the lightning icon taking 5-10s to appear
  • Improved performance of start anchors in queries like CELLS TOKS: ^
  • Fixed collaboration push actions not disappearing from UI after pushing
  • Fixed collaboration publish action conflicting with local project after publish
  • Fixed hinters' empirical expectations disappearing

2022-08-02 3.0.4

  • Align Application and Hub version numbers

2022-08-02 3.0.3

  • Fix suggestion engine query generation utf-8 bug
  • Fix crash when opening a project while another project is still loading
  • Fix hub authorization bug

2022-08-02 3.0.2

  • Fix role authorization flag issue

2022-08-02 3.0.1

  • Fix Windows build

2022-08-02 3.0.0

  • Introduces Guided Labeling for FTC powered by a new Suggestion Engine
  • Introduces an experience for annotator users
  • Exports now downloads the file via the browser, enabling dockerized deployments
  • Adds recall, precision and error rate charts
  • Fixed a bug in empirical hand label count feature in hinter list
  • Adds native case query support, for querying upper/lower/title case.
  • Adds anchors '^' and '$' to the query language, for querying start and end of contexts
  • Admin screen renamed to Team in Watchful Hub
  • Admin can now choose to Approve users before they have access to Watchful Hub
  • Query performance improvements
  • Improvements to project load times

2022-06-15 2.9.0

  • Add back hotkey bindings for ftc-recall hand labelling (y/n)
  • Remove "Project/" from projects page topnav
  • Fixed a bug in a library function that could cause the suggestion engine to crash
  • Sort classnames alphabetically in class selection
  • NER tokenization change. Potentially breaking change, but only if you are using "TOKS:" in your hinters. The change is that mixed runs of letters and numbers ("abc123", "12gram") now break into separate tokens.
  • NER sentencization change. "SENTS: " queries now include all tokens.
  • Handles errors during project load gracefully, displaying the error in the UI.
  • Add query cheat sheet
  • Make NER hand label candidate monospace and larger font
  • Make hinter create error messages more user friendly
  • SpaCy enrichment includes sentiment analysis

2022-05-11 2.8.1

  • Add field comparison query syntax (FieldA < FieldB, etc)
  • Remove prefix sampled statistics computations
  • Remove flicker from charts when applying actions
  • Improve presentation and flexibility of logging infrastructure

2022-04-06 2.8.0

  • All-new suggestion engine for NER classes (hinter and hand label suggestions)
  • Improves project load time for projects with many hand labels
  • Fix another NER plabel bug (wrong byte count in hinter stats)
  • Move class selection and base rate setting to sidebar
  • Remove approving empirical expectations from NER classes
  • Fixes attributes.py base64 encoding recursion error
  • Collaboration fetch does not sync unwanted directories
  • Updates label distribution tooltip to "Candidates X%", was "Candidates X"
  • Attribute file parsing validates utf-8 alignment
  • Renders hats and displays auto-correct beyond a single set of brackets

2022-02-16 2.7.1

  • Fix issue where hand labeling used a lot of memory
  • Decreases time it takes to switch between projects
  • Fix issue where error message was shown when pulling changes

2022-02-03 2.7.0

  • Fix bug where deleted classes would reappear
  • Fix NER plabel bug (select wrong hinter IDs)
  • Adds create_attribute_for_values() to attributes.py to more easily use a known set of values in Watchful
  • Update --streaming mode to use new query engine
  • NER for everyone (removes separate NER build)
  • Update hinter list expectation slider
  • Fix NER export "include negative plabels" option
  • Fix pagination to show hats after first page
  • Only show tags and plabels that belong to previewed text
  • Decreases timeout for hub url configuration
  • Remove precision labeling from NER
  • Attributes now merge rather than overwriting
  • Fixes highlighting issue related to ROWS
  • Fixes query highlighting edge case
  • Fix NER handlabel issues
  • Streaming mode now runs in parallel, using all available CPU cores.
  • Default select all NER export options
  • Sort classes by class-type in hand label dropdown
  • Remove Base Rate field for NER

2022-01-05 2.6.4

  • NER handlabel and chart support and export improvements
  • Parallel enrich.py. Note this adds a module to the requirements file, so pip will need to be re-run to pull this in.
  • Add confirmation modal to submit all empirical expectations
  • Separate classes by type in class dropdown
  • Add update page
  • Add user drawer
  • Add auth wall tooltip (behind feature flag) to share button