zotero/test/tests
Bogdan Abaev 2568b5ccc4 Semantic search on fulltext of attachments
Add optional pref to index and search fulltext of attachments.
When enabled, attachment IDs are enqueue after regular items,
notes, and annotations.

Added helpers to extract outline and sections from structured
text module. During indexing, the sections of the attachment
are extracted, large sections are broken into chunks, and
small sections are combined to fit into the context window
of the model. Then, each chunk is embedded with its outline
path as the prefix and added to embeddings table.
Each row now contains full text of the chunk
and it's path - a good amount of duplication needed to
ensure that we can reliably connect the embedding of
the chunk to its text for a preview.

On search in Best Match mode, attachment rows get the score
of the highest ranking chunk, so if there is a very relevant
chunk in an attachment, the regular item with a non-relevant
abstract will still rank highly.

When the attachment row is selected, top 5 matching chunks
appear in the new search results collapsible-section of
the item pane, so one can examine matching chunks
without opening the actual reader.
2026-08-13 13:39:30 -07:00
..
data Fix allowJavaScript option in HiddenBrowser 2026-07-24 13:11:50 -04:00
.eslintrc Add separate .eslintrc for tests 2019-09-16 01:28:52 -04:00
advancedSearchTest.js Add tests for best-match search interactions 2026-08-05 15:27:47 -04:00
annotationsTest.js Add tests for image annotation placeholder in notes 2026-03-24 12:09:15 -04:00
attachmentReadObserverTest.js Don't update read status when using Show File 2026-07-30 13:43:41 -04:00
attachmentsTest.js Move PMC lookup after open-access lookup 2026-07-30 20:56:28 -04:00
bibliographyTest.js Fix remaped styles not working in Document Preferences dialog 2025-12-16 16:33:45 +02:00
browserRequestTest.js Add support for clearing challenge in browser during translation 2026-04-23 15:34:28 -04:00
cachedTypesTest.js Fix primary item types not appearing in More menu when not in MRU list 2021-03-29 01:41:37 -04:00
citationDialogTest.js Citation dialog: Hide the citation preview until the citation has items 2026-07-28 12:29:59 -04:00
citeprocRsBridgeTest.js fx140: Asyncify/ESMify tests 2025-07-30 22:30:53 -04:00
citeTest.js Add accented stop-words to abbreviations word list 2026-07-20 22:52:51 -04:00
collectionsTest.js fx140: Asyncify/ESMify tests 2025-07-30 22:30:53 -04:00
collectionTest.js fx140: Asyncify/ESMify tests 2025-07-30 22:30:53 -04:00
collectionTreeRowTest.js Remove the singular collection tree selection getters 2026-07-29 13:12:47 -04:00
collectionTreeTest.js fx153: Set XUL checked/disabled as boolean attributes 2026-08-03 11:48:40 -04:00
collectionViewItemTreeTest.js Search note and annotation content 2026-08-11 11:27:04 -07:00
concurrentCallerTest.js Remove Bluebird methods in concurrentCallerTest.js 2025-07-30 22:30:57 -04:00
creatorsTest.js fx140: Asyncify/ESMify tests 2025-07-30 22:30:53 -04:00
dataDirectoryTest.js Remove Chai as Promised 2025-07-30 22:31:08 -04:00
dataObjectsTest.js Properly display annotations as rows of relatedBox (#5585) 2025-12-12 14:55:27 -05:00
dataObjectTest.js Track data object versions locally 2026-07-28 09:57:43 -04:00
dataObjectUtilitiesTest.js Diff saved-search conditions as an ordered list (#5962) 2026-06-25 16:14:38 -04:00
dateTest.js fx140: Asyncify/ESMify tests 2025-07-30 22:30:53 -04:00
dbTest.js Handle stale WAL files in corrupted-database recovery 2026-07-16 11:43:31 -04:00
debugTest.js Test debug output logging again 2023-05-24 20:59:29 +03:00
dictionariesTest.js fx-compat: Fix dictionaries tests 2022-06-19 04:16:53 -04:00
duplicatesTest.js avoid relation to self after merging related items (#5488) 2025-08-15 01:40:01 -04:00
embeddingsTest.js Semantic search on fulltext of attachments 2026-08-13 13:39:30 -07:00
feedItemsTest.js fx140: Asyncify/ESMify tests 2025-07-30 22:30:53 -04:00
feedItemTest.js Remove remaining chai-as-promised method calls 2025-07-30 22:31:08 -04:00
feedReaderTest.js Don't try to reject last feed item when FeedReader terminates 2025-07-30 22:31:08 -04:00
feedsTest.js Use alternate method to test feed check delay 2025-07-30 22:30:56 -04:00
feedTest.js Fix Zotero.Feed tests after chai-as-promised removal 2025-07-30 22:31:08 -04:00
fileChangeWatcherTest.js Fix file-change detection in all libraries after the first one synced 2026-06-10 22:26:13 -04:00
fileHandlersTest.js FileHandlers: Infer PDF pageIndex from annotation key 2025-07-30 11:37:52 -04:00
fileInterfaceTest.js Fix test for Citavi annotation import 2025-10-02 17:17:37 +01:00
fileRenamingDialogTest.js Extend the template engine and add template validation (#5989) 2026-07-29 13:30:12 -04:00
fileTest.js Use APFS cloning for file copies on macOS 2026-04-03 14:33:21 -04:00
folderImportTest.js fx140: Asyncify/ESMify tests 2025-07-30 22:30:53 -04:00
fulltextTest.js Fix looping re-extraction of full-text queue items with no text 2026-07-18 14:33:13 -04:00
groupsTest.js fx140: Asyncify/ESMify tests 2025-07-30 22:30:53 -04:00
groupTest.js Remove remaining chai-as-promised method calls 2025-07-30 22:31:08 -04:00
HiddenBrowserTest.js Add timeout to HiddenBrowser::getPageData() 2026-07-24 13:11:50 -04:00
httpTest.js Handle 429 and Retry-After in general HTTP layer 2026-05-20 15:08:52 -04:00
hyphenationTest.js close more leftover windows in tests (#5460) 2025-08-02 01:40:21 -04:00
importExportTest.js Update RDF tests 2026-03-06 16:51:25 -05:00
integrationTest.js Improve Add/Edit Citation button behaviour when cursor is in a non-citation Zotero field (#5935) 2026-06-03 03:51:26 -04:00
intlTest.js fx140: Asyncify/ESMify tests 2025-07-30 22:30:53 -04:00
itemFieldsTest.js fx140: Asyncify/ESMify tests 2025-07-30 22:30:53 -04:00
itemPaneTest.js itemPaneTest: Scroll to attachments pane instead of relying on pin 2026-07-08 10:50:32 -04:00
itemsTest.js Recently Read: Show matching children as regular rows 2026-06-16 13:52:14 -04:00
itemTest.js Don't throw getting the filename of a stored file with a corrupt path 2026-07-23 11:12:12 -04:00
itemTreeRowTest.js Item tree refactor megacommit 2026-04-27 14:44:39 -04:00
librariesTest.js Remove remaining chai-as-promised method calls 2025-07-30 22:31:08 -04:00
libraryTest.js Track data object versions locally 2026-07-28 09:57:43 -04:00
libraryTreeTest.js Tests: Don't auto-select collections and searches after creation 2024-06-24 02:45:20 -04:00
lookupTest.js Fix item tree focus checks broken by view-specific tree IDs 2026-06-08 13:21:15 -04:00
mendeleyImportTest.js Revert treating "arXiv ID" as a field in Mendeley import 2025-12-26 15:55:45 -05:00
mergeItemsTest.js Item merging: Don't merge trashed attachments of any type 2026-03-04 23:14:53 -05:00
mimeTest.js Add EPUB format to Zotero.MIME 2023-08-07 16:07:52 -04:00
noteeditorTest.js Improve undo/redo in the note editor (#3398) 2026-07-31 14:22:53 +02:00
noteTabTest.js Fix note tab reopen logic (#5706) 2026-01-20 10:56:04 -05:00
notifierTest.js fx140: Asyncify/ESMify tests 2025-07-30 22:30:53 -04:00
openurlTest.js fx140: Asyncify/ESMify tests 2025-07-30 22:30:53 -04:00
pluginAPITest.js Remove collectionTreeRow from the plugin menu context 2026-07-29 13:22:58 -04:00
preferences_accountTest.js fx153: Set XUL hidden/collapsed as boolean attributes 2026-08-03 11:48:40 -04:00
preferences_advancedTest.js Confirm before wiping the index on a Best-Match mode change 2026-08-05 15:41:41 -04:00
profileTest.js Fix erroneous data dir reuse in new profile on Windows 2026-04-27 16:04:52 -04:00
protocolHandlerTest.js Close window after protocol handler tests 2019-08-03 02:48:01 -04:00
proxyTest.js Import URL from XPCOM code instead of relying on window for Proxy code 2022-11-22 15:58:49 +02:00
quickCopyTest.js Stop using restoreProcessorState() (#5516) 2025-08-26 00:44:14 -04:00
readerTest.js Fix reopening reader tabs during queued close notifications 2026-07-17 20:11:49 +03:00
recognizeDocumentTest.js recognizeDocumentTest, translatorsTest: Initialize translators in before() 2026-07-08 10:50:32 -04:00
relatedboxTest.js filter out trashed items in relatedBox (#5482) 2025-08-13 23:56:40 -04:00
relationsTest.js fx140: Asyncify/ESMify tests 2025-07-30 22:30:53 -04:00
RemoteTranslateTest.js fx140: ESMify RemoteTranslate and uses 2025-07-30 22:30:30 -04:00
retractionsTest.js fx153: Set XUL hidden/collapsed as boolean attributes 2026-08-03 11:48:40 -04:00
rtfScanTest.js Improve RTF scan. Add test coverage. (#5672) 2026-02-02 15:03:57 -05:00
schemaTest.js Don't show Extra migration progress window unnecessarily 2026-07-23 23:21:01 -04:00
sdtTest.js Semantic search on fulltext of attachments 2026-08-13 13:39:30 -07:00
searchTest.js Normalize best-match queries 2026-08-05 15:27:48 -04:00
server_connectorIntegrationTest.js Server: Test new browser detection behavior 2026-04-28 13:05:31 -04:00
server_connectorTest.js Remove the singular collection tree selection getters 2026-07-29 13:12:47 -04:00
server_integrationTest.js Server: Test new browser detection behavior 2026-04-28 13:05:31 -04:00
server_localAPITest.js Local API: Don't validate Zotero-Server-ID for file uploads 2026-07-28 12:34:40 -06:00
serverTest.js Fix binary file corruption in multipart/form-data parsing 2026-07-28 09:57:43 -04:00
storageLocalTest.js Fix storageLocal test broken by ee68452b0 2026-07-21 11:08:42 -04:00
storageRequestTest.js fx140: Asyncify/ESMify tests 2025-07-30 22:30:53 -04:00
styleTest.js Fix citing and locale selection for locales without a CSL locale 2026-07-16 11:28:21 -04:00
supportTest.js Show more granular error for generateItemJSONData() test 2025-12-26 23:36:09 -05:00
syncAPIClientTest.js fx140: Asyncify/ESMify tests 2025-07-30 22:30:53 -04:00
syncedSettingsTest.js fx140: Asyncify/ESMify tests 2025-07-30 22:30:53 -04:00
syncEngineTest.js Save uploaded objects to the sync cache on an unchanged response 2026-07-29 00:06:42 -04:00
syncEventListenersTest.js fx140: Asyncify/ESMify tests 2025-07-30 22:30:53 -04:00
syncFullTextEngineTest.js Clarify naming of the full-text sync content processor 2026-07-15 15:36:40 -04:00
syncLocalTest.js fx153: Move to nsIPKCS11Token for the NSS key database 2026-08-03 11:48:41 -04:00
syncRunnerTest.js Fix sync runner test for updated login error button text 2026-03-19 15:48:16 -04:00
tabsTest.js Render citeproc.js markup in tab titles (#4602) 2024-08-26 07:57:17 -04:00
tagsboxTest.js Exclude trashed items from tag autocomplete suggestions 2026-07-22 11:46:52 -04:00
tagSelectorTest.js Remove the singular collection tree selection getters 2026-07-29 13:12:47 -04:00
tagsTest.js Fix error when removing a tag stored in a non-normalized form 2026-05-31 17:07:13 +02:00
templatesTest.js Extend the template engine and add template validation (#5989) 2026-07-29 13:30:12 -04:00
translateTest.js Fix open-access lookup for PMCID items during in-app translation 2026-07-30 20:55:16 -04:00
translatorsTest.js recognizeDocumentTest, translatorsTest: Initialize translators in before() 2026-07-08 10:50:32 -04:00
undoHistoryTest.js Respect skipDateModifiedUpdate of the operation when undoing it, fix #5971 2026-06-30 18:23:23 +02:00
uriTest.js fx140: Asyncify/ESMify tests 2025-07-30 22:30:53 -04:00
utilities_internalTest.js Move templating engine to a standalone, lazy-loaded module (#5989) 2026-07-29 13:30:03 -04:00
utilitiesSubmoduleTest.js Update utilities, move tests, add to CI (#2584) 2022-04-30 04:55:11 -04:00
virtualized-tableTest.js Item tree refactor megacommit 2026-04-27 14:44:39 -04:00
webdavTest.js Fix WebDAV tests for Account pane rename 2026-04-14 23:56:23 -04:00
zfsTest.js Rewrite HTTP.download() to stream via fetch() + ReadableStream 2026-04-17 14:17:40 -04:00
zoteroPaneTest.js Don't offer Remove from Collection if saved search is selected 2026-07-29 13:12:47 -04:00
zoteroTest.js Support saving and restoring main-window progress meter state 2026-07-16 11:43:31 -04:00