Jupyter Notebook to work with virtualenv which has libraries in it

[juhahu]

Adding libraries to Spark using virtualenvs doesn't work with Jupyter Notebook. Have to see how to make it work.

[juhahu]

Library included using Installing libraries with method 2. can be used also in Jupyter notebook when the new package is added to to sys.path.
Run these commands on notebook cell before importing new packages (assuming Python 3.6 is used):
import sys
sys.path.insert(0, '/mnt/\<cluster-name\>-pvc/scikit/lib/python3.6/site-packages/')

You can check if the path was added to first line of sys.path by running next command:
for p in sys.path: print(p)

After that, you can import new installed packages for example:
from spark_sklearn import GridSearchCV

Still need to figure out is there way to automate that to notebook initialization to remove need for user to add path for every notebook manually.