Reworked README & supplimenting docs (#512)

* initial revision of updated README

* fix broken links in doc files

* descriptive links, typos, anki emphasis

* add missing punctuation

* add new lines and capitalise letters

* move contributing section up

6 files changed, 274 insertions, 0 deletions

diff --git a/docs/advanced-options.md b/docs/advanced-options.md
new file mode 100644
index 00000000..f1740029
--- /dev/null
+++ b/docs/advanced-options.md
@@ -0,0 +1,10 @@
+## Advanced Options
+
+Click the `Advanced` toggle switch in the bottom left corner of the Settings page to enable advanced options.
+
+### Parse sentences using MeCab
+
+[MeCab](https://taku910.github.io/mecab/) is a third-party program which uses its own dictionaries and parsing algorithm to decompose sentences into individual words. MeCab may provide more accurate parsing results than Yomitan's internal parser.
+
+In order for Yomitan to use it, both MeCab and a native messaging component must be installed.
+A setup guide can be found [here](https://github.com/themoeway/yomitan-mecab-installer/blob/master/README.md).
diff --git a/docs/anki-integration.md b/docs/anki-integration.md
new file mode 100644
index 00000000..151137d4
--- /dev/null
+++ b/docs/anki-integration.md
@@ -0,0 +1,99 @@
+## Anki Integration
+
+Yomitan features automatic flashcard creation for [Anki](https://apps.ankiweb.net/), a free application designed to help you
+retain knowledge. This feature requires the prior installation of an Anki plugin called [AnkiConnect](https://foosoft.net/projects/anki-connect).
+Check the respective project page for more information about how to set up this software.
+
+### Flashcard Configuration
+
+Before flashcards can be automatically created, you must configure the templates used to create term and/or kanji notes.
+If you are unfamiliar with Anki deck and model management, this would be a good time to reference the [Anki
+Manual](https://docs.ankiweb.net/#/). In short, you must specify what information should be included in the
+flashcards that Yomitan creates through AnkiConnect.
+
+Flashcard fields can be configured with the following steps:
+
+1.  Open the Yomitan options page and scroll down to the section labeled _Anki Options_.
+2.  Tick the checkbox labeled _Enable Anki integration_ (Anki must be running with [AnkiConnect](https://foosoft.net/projects/anki-connect) installed).
+3.  Select the type of template to configure by clicking on either the _Terms_ or _Kanji_ tabs.
+4.  Select the Anki deck and model to use for new creating new flashcards of this type.
+5.  Fill the model fields with markers corresponding to the information you wish to include (several can be used at
+    once). Advanced users can also configure the actual [Handlebars](https://handlebarsjs.com/) templates used to create
+    the flashcard contents (this is strictly optional).
+
+    #### Markers for Term Cards
+
+    | Marker                     | Description                                                                                                              |
+    | -------------------------- | ------------------------------------------------------------------------------------------------------------------------ |
+    | `{audio}`                  | Audio sample of a native speaker's pronunciation in MP3 format (if available).                                           |
+    | `{clipboard-image}`        | An image which is stored in the system clipboard, if present.                                                            |
+    | `{clipboard-text}`         | Text which is stored in the system clipboard, if present.                                                                |
+    | `{cloze-body}`             | Raw, inflected term as it appeared before being reduced to dictionary form by Yomitan.                                   |
+    | `{cloze-prefix}`           | Fragment of the containing `{sentence}` starting at the beginning of `{sentence}` until the beginning of `{cloze-body}`. |
+    | `{cloze-suffix}`           | Fragment of the containing `{sentence}` starting at the end of `{cloze-body}` until the end of `{sentence}`.             |
+    | `{conjugation}`            | Conjugation path from the raw inflected term to the source term.                                                         |
+    | `{dictionary}`             | Name of the dictionary from which the card is being created (unavailable in _grouped_ mode).                             |
+    | `{document-title}`         | Title of the web page that the term appeared in.                                                                         |
+    | `{expression}`             | Term expressed as kanji (will be displayed in kana if kanji is not available).                                           |
+    | `{frequencies}`            | Frequency information for the term.                                                                                      |
+    | `{furigana}`               | Term expressed as kanji with furigana displayed above it (e.g. <ruby>日本語<rt>にほんご</rt></ruby>).                    |
+    | `{furigana-plain}`         | Term expressed as kanji with furigana displayed next to it in brackets (e.g. 日本語[にほんご]).                          |
+    | `{glossary}`               | List of definitions for the term (output format depends on whether running in _grouped_ mode).                           |
+    | `{glossary-brief}`         | List of definitions for the term in a more compact format.                                                               |
+    | `{glossary-no-dictionary}` | List of definitions for the term, except the dictionary tag is omitted.                                                  |
+    | `{part-of-speech}`         | Part of speech information for the term.                                                                                 |
+    | `{pitch-accents}`          | List of pitch accent downstep notations for the term.                                                                    |
+    | `{pitch-accent-graphs}`    | List of pitch accent graphs for the term.                                                                                |
+    | `{pitch-accent-positions}` | List of accent downstep positions for the term as a number.                                                              |
+    | `{reading}`                | Kana reading for the term (empty for terms where the expression is the reading).                                         |
+    | `{screenshot}`             | Screenshot of the web page taken at the time the term was added.                                                         |
+    | `{search-query}`           | The full search query shown on the search page.                                                                          |
+    | `{selection-text}`         | The selected text on the search page or popup.                                                                           |
+    | `{sentence}`               | Sentence, quote, or phrase that the term appears in from the source content.                                             |
+    | `{sentence-furigana}`      | Sentence, quote, or phrase that the term appears in from the source content, with furigana added.                        |
+    | `{tags}`                   | Grammar and usage tags providing information about the term (unavailable in _grouped_ mode).                             |
+    | `{url}`                    | Address of the web page in which the term appeared in.                                                                   |
+
+    #### Markers for Kanji Cards
+
+    | Marker                | Description                                                                                                              |
+    | --------------------- | ------------------------------------------------------------------------------------------------------------------------ |
+    | `{character}`         | Unicode glyph representing the current kanji.                                                                            |
+    | `{clipboard-image}`   | An image which is stored in the system clipboard, if present.                                                            |
+    | `{clipboard-text}`    | Text which is stored in the system clipboard, if present.                                                                |
+    | `{cloze-body}`        | Raw, inflected parent term as it appeared before being reduced to dictionary form by Yomitan.                            |
+    | `{cloze-prefix}`      | Fragment of the containing `{sentence}` starting at the beginning of `{sentence}` until the beginning of `{cloze-body}`. |
+    | `{cloze-suffix}`      | Fragment of the containing `{sentence}` starting at the end of `{cloze-body}` until the end of `{sentence}`.             |
+    | `{dictionary}`        | Name of the dictionary from which the card is being created.                                                             |
+    | `{document-title}`    | Title of the web page that the kanji appeared in.                                                                        |
+    | `{frequencies}`       | Frequency information for the kanji.                                                                                     |
+    | `{glossary}`          | List of definitions for the kanji.                                                                                       |
+    | `{kunyomi}`           | Kunyomi (Japanese reading) for the kanji expressed as katakana.                                                          |
+    | `{onyomi}`            | Onyomi (Chinese reading) for the kanji expressed as hiragana.                                                            |
+    | `{screenshot}`        | Screenshot of the web page taken at the time the kanji was added.                                                        |
+    | `{search-query}`      | The full search query shown on the search page.                                                                          |
+    | `{selection-text}`    | The selected text on the search page or popup.                                                                           |
+    | `{sentence}`          | Sentence, quote, or phrase that the character appears in from the source content.                                        |
+    | `{sentence-furigana}` | Sentence, quote, or phrase that the character appears in from the source content, with furigana added.                   |
+    | `{stroke-count}`      | Number of strokes that the kanji character has.                                                                          |
+    | `{url}`               | Address of the web page in which the kanji appeared in.                                                                  |
+
+When creating your model for Yomitan, _make sure that you pick a unique field to be first_; fields that will
+contain `{expression}` or `{character}` are ideal candidates for this. Anki does not allow duplicate flashcards to be
+added to a deck by default; it uses the first field in the model to check for duplicates. For example, if you have `{reading}`
+configured to be the first field in your model and <ruby>橋<rt>はし</rt></ruby> is already in your deck, you will not
+be able to create a flashcard for <ruby>箸<rt>はし</rt></ruby> because they share the same reading.
+
+### Flashcard Creation
+
+Once Yomitan is configured, it becomes trivial to create new flashcards with a single click. You will see the following
+icons next to term definitions:
+
+- Clicking ![](../img/btn-add-expression.png) adds the current expression as kanji (e.g. 食べる).
+- Clicking ![](../img/btn-add-reading.png) adds the current expression as hiragana or katakana (e.g. たべる).
+
+Below are some troubleshooting tips you can try if you are unable to create new flashcards:
+
+- Individual icons will appear grayed out if a flashcard cannot be created for the current definition (e.g. it already exists in the deck).
+- If all of the buttons appear grayed out, then you should double-check your deck and model configuration settings.
+- If no icons appear at all, make sure that Anki is running in the background and that [AnkiConnect](https://foosoft.net/projects/anki-connect) has been installed.
diff --git a/docs/dictionaries.md b/docs/dictionaries.md
new file mode 100644
index 00000000..73307c37
--- /dev/null
+++ b/docs/dictionaries.md
@@ -0,0 +1,51 @@
+## Dictionaries
+
+There are several free Japanese dictionaries available for Yomitan, with two of them having glossaries available in
+different languages. You must download and import the dictionaries you wish to use in order to enable Yomitan
+definition lookups. If you have proprietary EPWING dictionaries that you would like to use, check the [Yomitan
+Import](https://github.com/themoeway/yomitan-import) page to learn how to convert and import them into Yomitan.
+
+Be aware that non-English dictionaries contain fewer entries than their English counterparts. Even if your primary
+language is not English, you may consider also importing the English version for better coverage.
+
+- [Jitendex](https://github.com/stephenmk/Jitendex) - Jitendex is an improved version of JMdict for Yomitan. It features better formatting and some other improvements, and is actively being improved by its author.
+- [JMdict](https://github.com/themoeway/jmdict-yomitan#jmdict-for-yomitan-1) - There are daily automatically updated builds of JMdict for Yomitan available in this repository. It is available in multiple languages and formats, but we recommend installing the more modern Jitendex for English users.
+- [JMnedict](https://github.com/themoeway/jmdict-yomitan#jmnedict-for-yomitan) - JMnedict is a dictionary that lists readings of person/place/organization names and other proper nouns.
+- [KANJIDIC](https://github.com/themoeway/jmdict-yomitan#kanjidic-for-yomitan) - KANJIDIC is an English dictionary listing readings, meanings, and other info about kanji characters.
+
+### Importing Dictionaries
+
+Yomitan also supports exporting and importing your entire collection of dictionaries.
+
+#### Importing a Dictionary Collection
+
+- Go to Yomitan's settings page (click on the extension's icon then click on the cog icon from the popup)
+- Click `Import Dictionary Collection` and select the database file you want to import
+- Wait for the import to finish then turn all the dictionaries back on from the `Dictionaries > Configure installed and enabled dictionaries` section
+- Refresh the browser tab to see the dictionaries in effect
+
+#### Exporting the Dictionary Collection
+
+- Click `Export Dictionary Collection` from the backup section of Yomitan's settings page
+- It will show you a progress report as it exports the data then initiates a
+  download for a file named something like `yomitan-dictionaries-YYYY-MM-DD-HH-mm-ss.json`
+  (e.g. `yomitan-dictionaries-2023-07-05-02-42-04.json`)
+
+### Importing and Exporting Personal Configuration
+
+Note that you can also similarly export and import your Yomitan settings from the `Backup` section of the Settings page.
+
+You should be able to replicate your exact Yomitan setup across devices by exporting your settings and dictionary collection from the source device then importing those from the destination.
+
+## Custom Dictionaries
+
+Yomitan supports the use of custom dictionaries, including the esoteric but popular
+[EPWING](https://ja.wikipedia.org/wiki/EPWING) format. They were often utilized in portable electronic dictionaries
+similar to the ones pictured below. These dictionaries are often sought after by language learners for their correctness
+and excellent coverage of the Japanese language.
+
+Unfortunately, as most of the dictionaries released in this format are proprietary, they are unable to be bundled with
+Yomitan. Instead, you will need to procure these dictionaries yourself and import them using [Yomitan
+Import](https://github.com/themoeway/yomitan-import). Check the project page for additional details.
+
+![Pocket EPWING dictionaries](../img/epwing-devices.jpg)
diff --git a/docs/faq.md b/docs/faq.md
new file mode 100644
index 00000000..a972b0b9
--- /dev/null
+++ b/docs/faq.md
@@ -0,0 +1,58 @@
+## Frequently Asked Questions
+
+**I can't scan text in Firefox!**
+
+In Firefox's Manifest V3, host permissions are treated as opt-in. For Yomitan to work properly, the recommended permissions
+must be explicitly set. In the Yomitan welcome page, go to the `Recommended Permissions (Important)` section and check `Enable recommended permissions`.
+
+**I'm having problems importing dictionaries in Firefox, what do I do?**
+
+Yomitan uses the cross-browser IndexedDB system for storing imported dictionary data into your user profile. Although
+everything "just works" in Chrome, depending on settings, Firefox users can run into problems due to browser bugs.
+Yomitan catches errors and tries to offer suggestions about how to work around Firefox issues, but in general at least
+one of the following solutions should work for you:
+
+- Make sure you have cookies enabled. It appears that disabling them also disables IndexedDB for some reason. You
+  can still have cookies be disabled on other sites; just make sure to add the Yomitan extension to the whitelist of
+  whatever tool you are using to restrict cookies. You can get the extension "URL" by looking at the address bar when
+  you have the search page open.
+- Make sure that you have sufficient disk space available on the drive Firefox uses to store your user profile.
+  Firefox limits the amount of space that can be used by IndexedDB to a small fraction of the disk space actually
+  available on your computer.
+- Make sure that you have history set to "Remember history" enabled in your privacy settings. When this option is
+  set to "Never remember history", IndexedDB access is once again disabled for an inexplicable reason.
+- As a last resort, try using the [Refresh Firefox](https://support.mozilla.org/en-US/kb/reset-preferences-fix-problems)
+  feature to reset your user profile. It appears that the Firefox profile system can corrupt itself preventing
+  IndexedDB from being accessible to Yomitan.
+
+**Will you add support for online dictionaries?**
+
+Online dictionaries will not be implemented because it is not possible to support them in a robust way. In order to
+perform Japanese deinflection, Yomitan must execute dozens of database queries for every single word. Factoring in
+network latency and the fragility of web scraping, it would not be possible to maintain a good and consistent user
+experience.
+
+**Is it possible to use Yomitan with files saved locally on my computer with Chrome?**
+
+In order to use Yomitan with local files in Chrome, you must first tick the _Allow access to file URLs_ checkbox
+for Yomitan on the extensions page. Due to the restrictions placed on browser addons in the WebExtensions model, it
+will likely never be possible to use Yomitan with PDF files.
+
+**Is it possible to delete individual dictionaries without purging the database?**
+
+Yomitan is able to delete individual dictionaries, but keep in mind that this process can be _very_ slow and can
+cause the browser to become unresponsive. The time it takes to delete a single dictionary can sometimes be roughly
+the same as the time it originally took to import, which can be significant for certain large dictionaries.
+
+**Why aren't EPWING dictionaries bundled with Yomitan?**
+
+The vast majority of EPWING dictionaries are proprietary, so they are unfortunately not able to be included in
+this extension due to copyright reasons.
+
+**When are you going to add support for $MYLANGUAGE?**
+
+Developing Yomitan requires a decent understanding of Japanese sentence structure and grammar, and other languages
+are likely to have their own unique set of rules for syntax, grammar, inflection, and so on. Supporting additional
+languages would not only require many additional changes to the codebase, it would also incur significant maintenance
+overhead and knowledge demands for the developers. Therefore, suggestions and contributions for supporting
+new languages will be declined, allowing Yomitan's focus to remain Japanese-centric.
diff --git a/docs/keyboard-shortcuts.md b/docs/keyboard-shortcuts.md
new file mode 100644
index 00000000..bf12a84a
--- /dev/null
+++ b/docs/keyboard-shortcuts.md
@@ -0,0 +1,25 @@
+## Keyboard Shortcuts
+
+The following shortcuts are globally available:
+
+| Shortcut                           | Action                   |
+| ---------------------------------- | ------------------------ |
+| <kbd>Alt</kbd> + <kbd>Insert</kbd> | Open search page.        |
+| <kbd>Alt</kbd> + <kbd>Delete</kbd> | Toggle extension on/off. |
+
+The following shortcuts are available on search results:
+
+| Shortcut                         | Action                                  |
+| -------------------------------- | --------------------------------------- |
+| <kbd>Esc</kbd>                   | Cancel current search.                  |
+| <kbd>Alt</kbd> + <kbd>PgUp</kbd> | Page up through results.                |
+| <kbd>Alt</kbd> + <kbd>PgDn</kbd> | Page down through results.              |
+| <kbd>Alt</kbd> + <kbd>End</kbd>  | Go to last result.                      |
+| <kbd>Alt</kbd> + <kbd>Home</kbd> | Go to first result.                     |
+| <kbd>Alt</kbd> + <kbd>Up</kbd>   | Go to previous result.                  |
+| <kbd>Alt</kbd> + <kbd>Down</kbd> | Go to next result.                      |
+| <kbd>Alt</kbd> + <kbd>B</kbd>    | Go to back to source term.              |
+| <kbd>Alt</kbd> + <kbd>E</kbd>    | Add current term as expression to Anki. |
+| <kbd>Alt</kbd> + <kbd>R</kbd>    | Add current term as reading to Anki.    |
+| <kbd>Alt</kbd> + <kbd>P</kbd>    | Play audio for current term.            |
+| <kbd>Alt</kbd> + <kbd>K</kbd>    | Add current kanji to Anki.              |
diff --git a/docs/yomichan-migration.md b/docs/yomichan-migration.md
new file mode 100644
index 00000000..291c2966
--- /dev/null
+++ b/docs/yomichan-migration.md
@@ -0,0 +1,31 @@
+## Migrating from Yomichan
+
+### Exporting Data
+
+If you are an existing user of Yomichan, you can export your dictionary collection and settings such that they can be imported into Yomitan to reflect your setup exactly as it was.
+
+You can export your settings from Yomichan's Settings page. Go to the `Backup` section and click on `Export Settings`.
+
+Yomichan doesn't have first-class support to export the dictionary collection. Please follow the instructions provided in the following link to export your data:
+https://github.com/themoeway/yomichan-data-exporter#steps-to-export-the-data
+
+You can then import the exported files into Yomitan from the `Backup` section of the `Settings` page. Please see [the section on importing dictionaries](#importing-dictionaries) further below for more explicit steps.
+
+### Custom Templates
+
+If you do not use custom templates for Anki note creation, this section can be skipped.
+
+Due to security concerns, an alternate implementation of Handlebars is being used which behaves slightly differently.
+This revealed a bug in four of Yomitan's template helpers, which have now been fixed in the default templates. If your
+custom templates use the following helpers, please ensure their use matches the corrected forms.
+
+| Helper           | Example                                                       | Corrected                            |
+| ---------------- | ------------------------------------------------------------- | ------------------------------------ |
+| `formatGlossary` | `{{#formatGlossary ../dictionary}}{{{.}}}{{/formatGlossary}}` | `{{formatGlossary ../dictionary .}}` |
+| `furigana`       | `{{#furigana}}{{{definition}}}{{/furigana}}`                  | `{{furigana definition}}`            |
+| `furiganaPlain`  | `{{~#furiganaPlain}}{{{.}}}{{/furiganaPlain~}}`               | `{{~furiganaPlain .~}}`              |
+| `dumpObject`     | `{{#dumpObject}}{{{.}}}{{/dumpObject}}`                       | `{{dumpObject .}}`                   |
+
+Authors of custom templates may be interested to know that other helpers previously used and documented in the block
+form (e.g. `{{#set "key" "value"}}{{/set}}`), while not broken by this change, may also be replaced with the less verbose
+form (e.g. `{{set "key" "value"}}`). The default templates and helper documentation have been changed to reflect this.