Skip to content

Commit

Permalink
Update README to remove neuron view single instance limitation.
Browse files Browse the repository at this point in the history
  • Loading branch information
jessevig committed Apr 2, 2022
1 parent 9c94349 commit 24ed452
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -203,7 +203,7 @@ GPT-2 ([Notebook](notebooks/neuron_view_gpt2.ipynb),
RoBERTa
([Notebook](notebooks/neuron_view_roberta.ipynb))

Note that only one instance of the Neuron View may be displayed within a notebook. For full API, please refer to the [source](bertviz/neuron_view.py).
For full API, please refer to the [source](bertviz/neuron_view.py).

### Encoder-decoder models (BART, T5, etc.)

Expand Down Expand Up @@ -406,7 +406,7 @@ returned from Huggingface models). In some case, Tensorflow checkpoints may be l
* When running on Colab, some of the visualizations will fail (runtime disconnection) when the input text is long. To mitigate this, you may wish to filter the layers displayed by setting the **`include_layers`** parameter, as described [above](#filtering-layers).
* The *neuron view* only supports the custom BERT, GPT-2, and RoBERTa models included with the tool. This view needs access to the query and key vectors,
which required modifying the model code (see `transformers_neuron_view` directory), which has only been done for these three models.
Also, only one neuron view may be included per notebook.


### Attention as "explanation"?
* Visualizing attention weights illuminates one type of architecture within the model but does not
Expand Down

0 comments on commit 24ed452

Please sign in to comment.