Commit 6b992aff authored by seyonechithrananda's avatar seyonechithrananda
Browse files

docs pass, adding installation command

parent 4f061b06
Loading
Loading
Loading
Loading
+4 −1
Original line number Diff line number Diff line
@@ -22,13 +22,16 @@ Tokenization methods on string-based corpuses in the life sciences are becoming
SmilesTokenizer
^^^^^^^^^^^^^^^

The :code:`dc.feat.SmilesTokenizer` module inherits from the BertTokenizer class. It runs a WordPiece tokenization algorithm over SMILES strings using the tokenisation SMILES regex developed by Schwaller et. al.
The :code:`dc.feat.SmilesTokenizer` module inherits from the BertTokenizer class in transformers. It runs a WordPiece tokenization algorithm over SMILES strings using the tokenisation SMILES regex developed by Schwaller et. al.

The SmilesTokenizer employs an atom-wise tokenization strategy using the following Regex expression:

>>> SMI_REGEX_PATTERN = "(\[[^\]]+]|Br?|Cl?|N|O|S|P|F|I|b|c|n|o|s|p|\(|\)|\.
|¼|#||\+|\\\\\/|:||@|\?|>|\*|\$|\%[0–9]{2}|[0–9])"

To use, please install the transformers package using the following pip command:

>>> pip install transformers

References: