GitBucket
4.21.2
Toggle navigation
Snippets
Sign in
Files
Branches
2
Releases
Issues
3
Pull requests
Labels
Priorities
Milestones
Wiki
Forks
nigel.stanger
/
docker-analytics
Browse code
Merged pyspark-shell.sh into kernel.json
master
spark3
1 parent
9f9d413
commit
e8b457745774df9fffe9010f6ef8eb17d8a9e5e5
Nigel Stanger
authored
on 20 Sep 2021
Patch
Showing
3 changed files
Makefile
pyspark/kernel.json
pyspark/pyspark-kernel.sh
Ignore Space
Show notes
View
Makefile
all: spark pyspark kafka spark: spark/Dockerfile spark/start-master.sh spark/start-worker.sh docker build $(BUILD_OPTS) -t nstanger/spark:latest -f $< $@ # Rebuild both the following if spark changes! pyspark: pyspark/Dockerfile pyspark/kernel.json docker build $(BUILD_OPTS) -t nstanger/pyspark:latest -f $< $@ kafka: kafka/Dockerfile kafka/start-kafka.sh docker build $(BUILD_OPTS) -t nstanger/kafka:latest -f $< $@
all: spark pyspark kafka spark: spark/Dockerfile spark/start-master.sh spark/start-worker.sh docker build $(BUILD_OPTS) -t nstanger/spark:latest -f $< $@ # Rebuild both the following if spark changes! pyspark: pyspark/Dockerfile pyspark/kernel.json pyspark/pyspark-kernel.sh docker build $(BUILD_OPTS) -t nstanger/pyspark:latest -f $< $@ kafka: kafka/Dockerfile kafka/start-kafka.sh docker build $(BUILD_OPTS) -t nstanger/kafka:latest -f $< $@
Ignore Space
Show notes
View
pyspark/kernel.json
{ "display_name": "PySpark", "language": "python", "argv": [ "/usr/local/bin/python", "-m", "ipykernel", "-f", "{connection_file}" ] }
{ "display_name": "PySpark", "language": "python", "argv": [ "~/.local/share/jupyter/kernels/PySpark/pyspark-kernel.sh", "-f", "{connection_file}" ] }
Show notes
View
pyspark/pyspark-kernel.sh
100755 → 0
#!/bin/sh # Based on <https://github.com/jupyterhub/jupyterhub/issues/847>. exec /usr/local/bin/python3 -m ipykernel $@
Show line notes below