Comments (7)
This is true for other errors (when Livy returns 502 for example). We need to surface all of them.
from sparkmagic.
Good point. We already have the machinery in place to catch and display errors when Livy times out so we should leverage the same strategy for these.
from sparkmagic.
Ricky, will you tackle other errors too?
from sparkmagic.
I haven't seen any other errors. I did a quick test by pointing the magics to an incorrect URL and the error I got for that was sensible.
I don't know how to force Livy to return a 502 to me so I couldn't test that scenario in particular.
from sparkmagic.
Just go to a cluster and shut Livy down. Gateway will return 502.
Or point it to a non-Spark cluster.
Was the error you got surfaced to the user? In the past, I saw it not being surfaced to the user (just displayed in shell) and cell never returned.
from sparkmagic.
Let me give it a shot
from sparkmagic.
The kernel doesn't crash when the gateway returns 502. (This makes sense since we only try to connect to Livy after running the first cell.)
I am going to close this issue because I don't think any of us know of any situations where the error still happens.
from sparkmagic.
Related Issues (20)
- Sparkmagic Kerberos authentication issue HOT 1
- Plotly scala HOT 5
- Publish sparkmagic Docker images regularly HOT 1
- Run Tests Nightly to Catch Upstream Dependency Issues Earlier
- [BUG] Sparkmagic errors out using iPython 7.33.0 HOT 1
- pip deprecation warning when installing hdijupyterutils and autovizwidget HOT 1
- [QST] How to automatically load sparkmagic.magics when open a new ipython kernel tab HOT 1
- Document extending SparkMagic HOT 2
- how to pass python variable to %%sql cell ?
- [BUG] Default Docker container got broken HOT 4
- Support >= Pandas 2.0.0 HOT 6
- [BUG] error when first client connects HOT 1
- Jupyterlab 4.0.2 python 3.10 HOT 1
- [BUG] Cannot build Dockerfile.jupyter HOT 3
- [BUG] SparkMagic pyspark kernel magic(%%sql) hangs when running with Papermill. HOT 17
- Use variables in %%configure HOT 4
- [BUG] %%send-to-spark fails for dataframes with '\n' or ' characters HOT 2
- [BUG] launcher issue using jupyterlab 3.6.3 / sparkmagic 0.21.0 HOT 5
- Support notebook >= 7 HOT 1
- Does sparkmagic support dual scala/python spark session? HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from sparkmagic.