Comments (5)
Hi @Liorba , I am in the process of cutting a 1.0.4 with Spark 1.5
The Python API will be available once that happens. Due to a class loading issue before Spark 1.5, the Python API was not functional unless you patched Spark... but with 1.0.4 that should be fixed. In fact, the Python API issue is what is keeping up the 1.0.4 release as some implementation changes in Spark 1.5 as far as Python goes has introduced an issue in Magellan's Python code which I m currently debugging.
I'll let you know as soon as 1.0.4 is cut (which should be any day now)
from magellan.
Thanks @halfabrane for your quick response, really looking forward to try the new version
from magellan.
Hello,
Any update on when this will be ready?
Thank you
from magellan.
Hi @halfabrane, great news. I'm looking forward to trying this out as well!
from magellan.
Hi,
While importing the pyspark package in my server. Its killing the SparkContext. Error is given below. Please let me know how to resolve the given below issue
16/03/17 02:28:47 ERROR SparkContext: Error initializing SparkContext.
org.apache.spark.SparkException: Yarn application has already ended! It might have been killed or unable to launch application master.
at org.apache.spark.scheduler.cluster.YarnClientSchedulerBackend.waitForApplication(YarnClientSchedulerBackend.scala:124)
at org.apache.spark.scheduler.cluster.YarnClientSchedulerBackend.start(YarnClientSchedulerBackend.scala:64)
at org.apache.spark.scheduler.TaskSchedulerImpl.start(TaskSchedulerImpl.scala:144)
at org.apache.spark.SparkContext.(SparkContext.scala:530)
at org.apache.spark.api.java.JavaSparkContext.(JavaSparkContext.scala:59)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:422)
at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:234)
at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:381)
at py4j.Gateway.invoke(Gateway.java:214)
at py4j.commands.ConstructorCommand.invokeConstructor(ConstructorCommand.java:79)
at py4j.commands.ConstructorCommand.execute(ConstructorCommand.java:68)
at py4j.GatewayConnection.run(GatewayConnection.java:209)
at java.lang.Thread.run(Thread.java:745)
from magellan.
Related Issues (20)
- How to debug index usage crashes? HOT 6
- Guava StopWatch use causing dependency issue
- Broadcast Timeout on Ontario GeoJson boundary
- WKT parser problem HOT 3
- Snapshots available? HOT 1
- Problem while converting coordinates to point in Spark 2.3.1 and Scala 2.11 HOT 3
- Cannot perform join between points and polygon using Scala 2.11 and Spark 2.3.1 HOT 9
- Cannot imort magellan.coord.NAD83
- What does this work with? HOT 5
- obtaining a list of geohashes representing neighborhoods zones HOT 2
- Next Release HOT 1
- How to run the NYC Taxicab analysis notebook with Azure DataBricks HOT 3
- Point not found when injectRules used HOT 4
- Issue with checking point within polygon
- Magellan on DataBricks Community Edition? HOT 2
- Tutorial Issue finding 'point' HOT 2
- Add Support for Spark 2.4.3 and above
- Python Support
- NoClassDefFoundError
- Empty metadata while reading data from shape file or geojson file
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from magellan.