entropyorg / p5-devel-iperl Goto Github PK

Need to have the latest stable IPython (at least)

• sudo pip install ipython[all] --upgrade
  (see http://ipython.org/ipython-doc/stable/install/install.html#installation-using-pip)
  Need to note the versions installed by OS repo managers (e.g., many are using IPython 0.13.1 and that is too old.)
• add a Developers page to the wiki
• Add info about lexical variables and named subs if they can not be handle by the REPL (see doy/reply#43).

Create a dev directory with provisioning scripts. Add all this to MANIFEST.SKIP.

Compile the Perl source to find common errors as you type.

• need to see if ZMQ can be installed on all systems
• perhaps http://p3rl.org/ZMQ::FFI may help?
• The IPython messaging protocol uses ZeroMQ. This might make the kernel not as portable as it could
  be. There are several solutions to this.
  • Create a new wire protocol entirely using Perl and sockets. Frontends that support this protocol
    would need to be written.
  • Try to ensure ZeroMQ works everywhere. There exist the Alien::ZeroMQ and ZeroMQ::FFI distributions
    which could help avoid compilation on some platforms.
• Make sure Alien::ZMQ works everywhere. Perhaps it can use Alien::Base.
• lestrrat-p5/ZMQ#13, chazmcgarvey/p5-Alien-ZMQ#1

See ipython/ipython#6126 to see how live notebook switching works.

/home/zaki/sw_projects/p5-Devel-IPerl/ipython/IPython/kernel/manager.py:91: UserWarning: Setting kernel_cmd is deprecated, use kernel_spec to start different kernels.
warnings.warn("Setting kernel_cmd is deprecated, use kernel_spec to "
IPython Console 3.0.0-dev

IPython profile: perl

• ipython/ipython#7036

• Convert images (to files?).
• Add a link to nbviewer version.
• Integrate with GitHub.
• options to include stderr/stdout

It currently does not work at all. See discussion on #perl6.

What it requires is better ZeroMQ bindings (see the zavolaj native call API).

Forked to https://github.com/zmughal/iperl6kernel

Is there a way to get some variable and function colors into the notebook?

Just installed Devel::IPerl on a 5.20 threaded perl on OS X 10.11.1. The install went through after getting Cairo to install; needed to reinstall cairo via homebrew.

Running a jupyter notebook went into a kernel death spiral until I installed B::Keywords.

It's working now! Woo!

I asked a question about execution semantics of the "single" mode here http://mail.scipy.org/pipermail/ipython-dev/2015-January/015764.html.

You can set the mode if you are using Python by setting the interactivity parameter of run_ast_nodes():

import IPython.core.interactiveshell as intshell
intshell.InteractiveShell.ast_node_interactivity = 'last' # ‘all’, ‘last’, ‘last_expr’ or ‘none’,

I see the kernel registered now, but the colored syntax is lost when the cell is executed.

if a subroutine is saved in a cell and then recompiled, the notebook can't be saved. The redefined subroutine issue is avoidable, but it may be a common issue.

Notebook Validation failed: [u'Subroutine kgd_tp redefined at reply input line 12.\n'] is not of type u'string':
[
"Subroutine kgd_tp redefined at reply input line 12.\n"
]

Compilation errors need to caught and returned on stderr

• There are some execution semantics and message types in the messaging protocol that I haven't yet
  implemented/understood (see #20). I need to go through these and see if they are necessary.

There is now a tool to test the message spec: see ipython/ipython#7646. https://github.com/jupyter/jupyter_kernel_test.

• Handling output streams in an async way is currently not supported.
  For example:

      for (0..2) {
         say "test";
         sleep 2;
      }

will take 6 seconds to run before it prints out "test" 3 times. I am assuming the best way
to do this is to spawn a child process with redirected output handles and monitor its output.
Perhaps by using IO::Pty. It is important to keep in mind how portable that
may be.

using the command line from a cell with back ticks worked for me before (e.g. perldoc Foo::Bar), but not with the most recent changes.

See http://irclog.perlgeek.de/pdl/2015-06-21#i_10781748 (will add more details later, execute_reply, text/plain MIME output (via IPerl->display( "a string" ), quick MIME output ( IPerl->display_mime( "text/plain" => "hi!" ) )

@jberger++

The readlink line in the iperl script is causing the kernel to crash on my os x machine. I commented out the line and it works well for me.

use Modern::Perl;
say 'something'; #works

new cell
say 'something'; #error

• Alien::ZMQ3
• Alien::LIbMagic

I am using ipython 2.20, and with recent release like 0.005, iperl does not work. It seems that earlier ipython does not support "ipython console --kernel xxx".

https://speakerdeck.com/fperez/project-jupyter
https://github.com/jupyter

http://beakernotebook.com/

• https://github.com/twosigma/beaker-notebook/wiki/Importing-Plugins-form-IPython

https://github.com/nteract/nteract

• https://blog.jupyter.org/2016/07/14/jupyter-lab-alpha/

• Start IPython console with IPerl
• Run a single line of code via the console and get an expected output.
• Test I/O under both Devel::REPL and Reply (using only plugins install with core Perl)

Code snippets

• use strict;
• lexical variables
• package variables
• define function
• for loop

See the following from IPython documentation:

• https://github.com/ipython/ipython/wiki/widgets,
• https://github.com/ipython/ipywidgets,
• http://nbviewer.ipython.org/github/ipython/ipython/blob/master/examples/Interactive%20Widgets/Index.ipynb,
• https://github.com/ipython/jsplugins
• https://ipython.org/ipython-doc/dev/api/generated/IPython.html.widgets.widget.html
• http://mdtraj.org/latest/viewer.html
• https://scipy-lectures.github.io/intro/matplotlib/matplotlib.html
• http://bokeh.pydata.org/en/latest/docs/user_guide/embedding.html#ipython-notebook
• https://gabrielelanaro.github.io/blog/2014/12/04/chemview-3d-chemistry-browser.html
• https://mpld3.github.io/modules/API.html#mpld3.enable_notebook
• https://ipython.org/ipython-doc/dev/config/integrating.html

• I want to see bidirectional interactive JS working with IPerl. It would be neat to be able to
  be able to use Xtk for volume rendering and be able to get events
  back to Perl code and then call back to JS .

Since warnings can be emitted with a stacktrace, figure out how to best fit them into the IPython messaging spec.

See ML message: http://mail.scipy.org/pipermail/ipython-dev/2015-February/015960.html

Should not use IO::Async's spawn_child function since Windows does not support POSIX fork().

• CPAN modules that might help: Module::Reload, Module::Reload::Selective, Class::Unload, again, Module::Refresh, Class::Refresh
• How well does this work with Moo[se]?

IPython extension: http://ipython.org/ipython-doc/stable/config/extensions/autoreload.html

package Experiment {
use Moo;

has [ qw( param1 param2 param3 ) ] => ( is => 'rw' );
has data => ( is => 'rw' );

};

I should be able to come back later and add another attribute to the Moo class and not have it give me the error: You cannot overwrite a locally defined method (attribute_name) with an accessor at...

I know in IPerl we can use DDP or Data::Dumper and explicitly call p() or Dumper() to pretty-print variables. But can we make it behave like the reply or re.pl in that it automatically does pretty-print on entering a variable or evaluating an expression?

https://github.com/ivanov/vim-ipython
https://github.com/tkf/emacs-ipython-notebook
https://github.com/aaren/notedown
https://github.com/ivanov/ipython-vimception

nbconvert (and thus the nbviewer service) uses the pygments lexer to highlight code when generating static HTML files.

See #24.

Probably use the Ruby lexer as a base as it is most similar to Perl.

Both ZMQ::LibZMQ3 and ZMQ::LibZMQ4 should be supported.

See also issue with deprecated functions in https://rt.cpan.org/Ticket/Display.html?id=105652 and https://github.com/EntropyOrg/p5-Devel-IPerl/tree/fix/zmq-ctx-api.

• A way to look up the POD documentation of a function/module.

• Support for D3.js using a matplotlib API is available through mpld3.
  It may be possible to provide a Perl API to the same JS.

• Replace the small proof-of-concept content sniffing display hook
  with a pluggable system that has better support for MIME types and
  user configuration. It currently uses libmagic, so this needs to compile on all platforms.
  The Julia multimethod approach with MIME types and type pattern matching may be the way to go.
  See the multimedia I/O section
  of the base standard library. I am thinking that Type::Tiny could
  be useful here.

• The shell script for starting iperl (bin/iperl) needs to be converted to Perl for portability.
  I think that it should just be a wrapper around the ipython command except that it will also
  help create and load Perl profiles.

• Upon shutdown of the language kernel, ZeroMQ gives the following error:

      Bad file descriptor (epoll.cpp:67)
  

  I have a feeling this is because a part of the kernel is trying to read from a socket after
  the frontend has closed it.

Some of my students use windows

I'm having difficulty opening old iperl notebooks jupyter notebook after installing ipython4. I can load and reload a new iperl notebook.

• Code completion in the code cells. Perhaps Padre
  and Farabi have implementations to look at.

• Work with Software Carpentry to create a Perl curriculum using IPerl? (fixed link)

A Perl Back End

The IPython Notebook doesn't have to use Python as the back-end process:
they've defined a JSON-based protocol for communicating with arbitrary processes,
and people have already built a replacement back-end in Julia (and are working on one in R).
There are lots of Perl programmers in science;
a Perl back-end would probably get a lot of love.

• answer this SO question http://stackoverflow.com/questions/556050/is-there-anything-like-ipython-irb-for-perl
• comment on this blog http://pablomarin-garcia.blogspot.com/2012/11/looking-for-perl-tool-like-ipython.html
• work with bgruening/galaxy-ipython#19

• As always, the code needs more documentation, refactoring, logging, debugging tools and testing.
  The testing will require making a small frontend client. I think it needs more tests before it can
  go on CPAN and the only way to figure out what those tests should be like is by using the code.

Needs more work:

• multiplot does not work: Error: "Can't set hardcopy while in multiplot mode!"
• outputs "(killed gnuplot)" to STDERR when replotting. Trying to capture this causes issues.

https://github.com/ipython/ipython/wiki/IPEP-25:-Registry-of-installed-kernels

See http://mail.scipy.org/pipermail/ipython-dev/2015-June/016461.html and ipython/ipython#8511

Now that both Devel::REPL and Reply are both supported, there needs to be a way of configuring how those are started up.

• choose which backend to use
• choose which plugins to load for that particular REPL

Easier to install and faster to load.

Enhance the setup script to register IPerl as plugin in the normal ipython notebook.