scalacenter / scaladex Goto Github PK

View Code? Open in Web Editor NEW

189.0 18.0 75.0 82.83 MB

The Scala Package Index

Home Page: https://index.scala-lang.org

License: BSD 3-Clause "New" or "Revised" License

Scala 79.85% HTML 13.30% Shell 0.03% SCSS 6.83%

scala bintray scm-tag index packages sonatype scaladex

scaladex's Introduction

Scaladex

Scaladex is the website where the open source Scala libraries are indexed. Its main purpose is to help Scala developers find useful libraries and to help library authors promote their libraries and find new contributors.

Acknowledgments

This project is funded by the Scala Center.

How it works

Scaladex receives poms automatically from Maven Central (Sonatype) based on the binary version of the artifact ID. Some valid Scala binary versions are _2.13, _3, _sjs1_3, _native0.4_2.13, _2.12_1.0.

Scaladex associates a new artifact to a project by looking at the scm (Source Code Management) attribute in the pom file. At the moment Scaladex only supports Github repositories.

The description of a project (its readme, its avatar, its website link...) are automatically downloaded from Github.

Troubleshooting

My project is missing or some artifacts are missing

Did you publish the artifacts to Maven Central?

Check out how to publish to Maven Central with sbt or Mill:

You can also watch The Last 10 Percent by Stefan Zeiger.

What is the binary version of your artifacts?

If your artifact does not have any binary version it is considered a Java artifact and it will not be automatically indexed. Yet some Java artifact are closely related to Scala. In that case you can force its indexing by updating the non-standard.json file in the scaladex-contrib repository.

At the moment we don't support full Scala binary versions, that are often used in Scala compiler plugins.

Does the pom file contain the `scm` attribute and does it points to a public Github repository?

If not you can claim that the artifact belongs to your Github repository by updating the claims.json file in the scaladex-contrib repository.

If your project is not hosted by Github you should consider creating a mirror of it in Github.

Do not forget to update the scmInfo setting in your build file before the next release.

My project is hard to find in the search page

Read How to improve the visibility of your project.

How to contribute

Read the Contributing Guide and use Github Discussions for doubts.

Badges

Show the versions of Scala supported by your project!

You can add this badge to the README.MD of your own GitHub projects to show the versions of Scala they support:

The badge above only summarises latest JVM artifacts, if you'd like a badge for Scala JS or Scala Native, add a targetType=... query-string parameter:

Smaller, shorter badges

For more information read the shields.io API

scaladex's People

Contributors

Stargazers

Watchers

Forkers

gitter-badger ktoso waffle-iron takezoe olafurpg netzwerg adgelbfish intracer adam-wyluda alexdeleon 2m philwills adamvoss masseguillaume brendanobra travissarles dreadchild raboof michaelviveros sbrunk jducoeur kailuowang megri laughedelic mpollmeier piotrkwiecinski manohar9999 tdhulster sethtisue rjsvaljean andsarr olegych grogs wkomendera philippus jtownson atry gabro shanedelmore stephen-zhao rodrigogdea rusucosmin gmarti eed3si9n joriscode sjrd mlachkar adpi2 scalacommunitybuild tgodzik wojciechmazur akiomik rtyley sdrafahl bplommer vincenzobaz scala-steward ckipp01 jyoo980 barkingbad armanbilge joke1196 isgasho keynmol laurin-no muskan3006 dongxuwang windymelt xuwei-k mfirry eusme santhoshmani1 ayushkoli772 shrikha17 vosid8

scaladex's Issues

filter artifact & releases in project page

two dropdowns:

artifact name
release

filter on backend

Scala Days Berlin v2

Some pages can't fetch README

An example is here: https://index.scala-lang.org/lihaoyi/derive

Also, this page is repeating the right column again.

Search bar, add project description to drop down

@MasseGuillaume will make sure cleaner search results are returned and that the description field is available. But it would be nice to include the project description in the drop-down search bar à la npm https://www.npmjs.com

Templating engine

follow redirects when downloading github readmes

https://github.com/scalacenter/scaladex2/blob/master/data/src/main/scala/ch.epfl.scala.index.data/github/GithubDownload.scala#L73

this should be a stream graph with retries

Search page

pagination + style
order by (stars, fork, latest release)
keywords (api)

Index private repositories

Eugene Platonov at ebay said it would be helpful to index private repos. For example, they could look for reverse dependencies to notify them for breaking api changes.

UI: badge per license type, hover-over explaining it

Integrate look & feel with scala-lang.org

Use Jenkins to build/deploy

Build + deploy upon Github post-commit

Main Scaladex landing page

Subdomain of scala-lang for package index

Possible names:

index.scala-lang.org
package.scala-lang.org

important libs not showing up

Add keywords to backend. Searchable

Index scala-lang.org poms

render app server side

Admin-level users, edit-all capabilities

Backend/UI both. Use already written Oauth2 stuff to autheneticate a list of "admins". As low-level as possible for now.

http -> https for scala-lang.org

Connect front page with Backend

UI: Updating Project Info

Which fields will be updatable? (@MasseGuillaume + @heathermiller will provide a list)
@MasseGuillaume makes sure there's some update function to be used by the front-end

Internal error when querying API

http://localhost:8080/api/find?query=rapture
generates There was an internal server error.
with Console stacktrace

webappJVM [ERROR] [05/31/2016 01:13:36.036] [scaladex-akka.actor.default-dispatcher-31] [akka.actor.ActorSystemImpl(scaladex)] Error during processing of request HttpRequest(HttpMethod(GET),http://localhost:8080/api/find?query=rapture,List(Host: localhost:8080, Connection: keep-alive, Accept: text/html, application/xhtml+xml, application/xml;q=0.9, image/webp, */*;q=0.8, Upgrade-Insecure-Requests: 1, User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.2661.102 Safari/537.36, Accept-Encoding: gzip, deflate, sdch, Accept-Language: en-US, en;q=0.8, fr;q=0.6, Timeout-Access: <function1>),HttpEntity.Strict(none/none,ByteString()),HttpProtocol(HTTP/1.1))
webappJVM upickle.Invalid$Data: Key Missing: preRelease (data: {
webappJVM     "major": "1",
webappJVM     "minor": "1",
webappJVM     "patch": [
webappJVM         "0"
webappJVM     ]
webappJVM })
webappJVM   at upickle.GeneratedUtil$class.mapToArray(GeneratedUtil.scala:45)
webappJVM   at upickle.default$.mapToArray(Api.scala:25)
webappJVM   at upickle.Implicits$$anonfun$CaseR$1.applyOrElse(Implicits.scala:90)
webappJVM   at upickle.Implicits$$anonfun$CaseR$1.applyOrElse(Implicits.scala:89)
webappJVM   at upickle.Types$Reader$$anon$2.apply(Types.scala:113)
webappJVM   at upickle.Types$Reader$$anon$2.apply(Types.scala:103)
webappJVM   at upickle.Types$class.readJs(Types.scala:160)
webappJVM   at upickle.default$.readJs(Api.scala:25)
webappJVM   at upickle.default$.readJs(Api.scala:25)
webappJVM   at upickle.Generated$$anonfun$Tuple4R$1.applyOrElse(Generated.scala:39)
webappJVM   at upickle.Generated$$anonfun$Tuple4R$1.applyOrElse(Generated.scala:39)
webappJVM   at upickle.Implicits$Internal$$anon$1.apply(Implicits.scala:53)
webappJVM   at upickle.Implicits$Internal$$anon$1.apply(Implicits.scala:50)
webappJVM   at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123)
webappJVM   at upickle.Implicits$Internal$$anon$1.applyOrElse(Implicits.scala:50)
webappJVM   at upickle.Types$Reader$$anon$2.apply(Types.scala:113)
webappJVM   at upickle.Types$Reader$$anon$2.apply(Types.scala:103)
webappJVM   at upickle.Implicits$$anonfun$CaseR$1.applyOrElse(Implicits.scala:90)
webappJVM   at upickle.Implicits$$anonfun$CaseR$1.applyOrElse(Implicits.scala:89)
webappJVM   at upickle.Types$Reader$$anon$2.apply(Types.scala:113)
webappJVM   at upickle.Types$Reader$$anon$2.apply(Types.scala:103)
webappJVM   at upickle.Types$class.readJs(Types.scala:160)
webappJVM   at upickle.default$.readJs(Api.scala:25)
webappJVM   at upickle.default$.readJs(Api.scala:25)
webappJVM   at upickle.Generated$$anonfun$Tuple9R$1.applyOrElse(Generated.scala:79)
webappJVM   at upickle.Generated$$anonfun$Tuple9R$1.applyOrElse(Generated.scala:79)
webappJVM   at upickle.Implicits$Internal$$anon$1.apply(Implicits.scala:53)
webappJVM   at upickle.Implicits$Internal$$anon$1.apply(Implicits.scala:50)
webappJVM   at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123)
webappJVM   at upickle.Implicits$Internal$$anon$1.applyOrElse(Implicits.scala:50)
webappJVM   at upickle.Types$Reader$$anon$2.apply(Types.scala:113)
webappJVM   at upickle.Types$Reader$$anon$2.apply(Types.scala:103)
webappJVM   at upickle.Implicits$$anonfun$CaseR$1.applyOrElse(Implicits.scala:90)
webappJVM   at upickle.Implicits$$anonfun$CaseR$1.applyOrElse(Implicits.scala:89)
webappJVM   at upickle.Types$Reader$$anon$2.apply(Types.scala:113)
webappJVM   at upickle.Types$Reader$$anon$2.apply(Types.scala:103)
webappJVM   at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123)
webappJVM   at upickle.Types$Reader$$anon$2.applyOrElse(Types.scala:103)
webappJVM   at upickle.Implicits$Internal$$anon$1.apply(Implicits.scala:53)
webappJVM   at upickle.Implicits$Internal$$anon$1.apply(Implicits.scala:50)
webappJVM   at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123)
webappJVM   at upickle.Implicits$Internal$$anon$1.applyOrElse(Implicits.scala:50)
webappJVM   at upickle.Types$Reader$$anon$2.apply(Types.scala:113)
webappJVM   at upickle.Types$Reader$$anon$2.apply(Types.scala:103)
webappJVM   at upickle.Types$class.readJs(Types.scala:160)
webappJVM   at upickle.default$.readJs(Api.scala:25)
webappJVM   at upickle.Implicits$$anonfun$SeqishR$1$$anonfun$applyOrElse$1.apply(Implicits.scala:146)
webappJVM   at upickle.Implicits$$anonfun$SeqishR$1$$anonfun$applyOrElse$1.apply(Implicits.scala:146)
webappJVM   at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
webappJVM   at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
webappJVM   at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
webappJVM   at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48)
webappJVM   at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
webappJVM   at scala.collection.AbstractTraversable.map(Traversable.scala:104)
webappJVM   at upickle.Implicits$$anonfun$SeqishR$1.applyOrElse(Implicits.scala:146)
webappJVM   at upickle.Implicits$$anonfun$SeqishR$1.applyOrElse(Implicits.scala:146)
webappJVM   at upickle.Implicits$Internal$$anon$1.apply(Implicits.scala:53)
webappJVM   at upickle.Implicits$Internal$$anon$1.apply(Implicits.scala:50)
webappJVM   at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123)
webappJVM   at upickle.Implicits$Internal$$anon$1.applyOrElse(Implicits.scala:50)
webappJVM   at upickle.Types$Reader$$anon$2.apply(Types.scala:113)
webappJVM   at upickle.Types$Reader$$anon$2.apply(Types.scala:103)
webappJVM   at upickle.Types$class.readJs(Types.scala:160)
webappJVM   at upickle.default$.readJs(Api.scala:25)
webappJVM   at upickle.default$.readJs(Api.scala:25)
webappJVM   at upickle.Generated$$anonfun$Tuple3R$1.applyOrElse(Generated.scala:31)
webappJVM   at upickle.Generated$$anonfun$Tuple3R$1.applyOrElse(Generated.scala:31)
webappJVM   at upickle.Implicits$Internal$$anon$1.apply(Implicits.scala:53)
webappJVM   at upickle.Implicits$Internal$$anon$1.apply(Implicits.scala:50)
webappJVM   at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123)
webappJVM   at upickle.Implicits$Internal$$anon$1.applyOrElse(Implicits.scala:50)
webappJVM   at upickle.Types$Reader$$anon$2.apply(Types.scala:113)
webappJVM   at upickle.Types$Reader$$anon$2.apply(Types.scala:103)
webappJVM   at upickle.Implicits$$anonfun$CaseR$1.applyOrElse(Implicits.scala:90)
webappJVM   at upickle.Implicits$$anonfun$CaseR$1.applyOrElse(Implicits.scala:89)
webappJVM   at upickle.Types$Reader$$anon$2.apply(Types.scala:113)
webappJVM   at upickle.Types$Reader$$anon$2.apply(Types.scala:103)
webappJVM   at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123)
webappJVM   at upickle.Types$Reader$$anon$2.applyOrElse(Types.scala:103)
webappJVM   at upickle.Implicits$Internal$$anon$1.apply(Implicits.scala:53)
webappJVM   at upickle.Implicits$Internal$$anon$1.apply(Implicits.scala:50)
webappJVM   at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123)
webappJVM   at upickle.Implicits$Internal$$anon$1.applyOrElse(Implicits.scala:50)
webappJVM   at upickle.Types$Reader$$anon$2.apply(Types.scala:113)
webappJVM   at upickle.Types$Reader$$anon$2.apply(Types.scala:103)
webappJVM   at upickle.Types$class.readJs(Types.scala:160)
webappJVM   at upickle.default$.readJs(Api.scala:25)
webappJVM   at upickle.Implicits$$anonfun$SeqishR$1$$anonfun$applyOrElse$1.apply(Implicits.scala:146)
webappJVM   at upickle.Implicits$$anonfun$SeqishR$1$$anonfun$applyOrElse$1.apply(Implicits.scala:146)
webappJVM   at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
webappJVM   at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
webappJVM   at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
webappJVM   at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48)
webappJVM   at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
webappJVM   at scala.collection.AbstractTraversable.map(Traversable.scala:104)
webappJVM   at upickle.Implicits$$anonfun$SeqishR$1.applyOrElse(Implicits.scala:146)
webappJVM   at upickle.Implicits$$anonfun$SeqishR$1.applyOrElse(Implicits.scala:146)
webappJVM   at upickle.Implicits$Internal$$anon$1.apply(Implicits.scala:53)
webappJVM   at upickle.Implicits$Internal$$anon$1.apply(Implicits.scala:50)
webappJVM   at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123)
webappJVM   at upickle.Implicits$Internal$$anon$1.applyOrElse(Implicits.scala:50)
webappJVM   at upickle.Types$Reader$$anon$2.apply(Types.scala:113)
webappJVM   at upickle.Types$Reader$$anon$2.apply(Types.scala:103)
webappJVM   at upickle.Types$class.readJs(Types.scala:160)
webappJVM   at upickle.default$.readJs(Api.scala:25)
webappJVM   at upickle.default$.readJs(Api.scala:25)
webappJVM   at upickle.Generated$$anonfun$Tuple8R$1.applyOrElse(Generated.scala:71)
webappJVM   at upickle.Generated$$anonfun$Tuple8R$1.applyOrElse(Generated.scala:71)
webappJVM   at upickle.Implicits$Internal$$anon$1.apply(Implicits.scala:53)
webappJVM   at upickle.Implicits$Internal$$anon$1.apply(Implicits.scala:50)
webappJVM   at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123)
webappJVM   at upickle.Implicits$Internal$$anon$1.applyOrElse(Implicits.scala:50)
webappJVM   at upickle.Types$Reader$$anon$2.apply(Types.scala:113)
webappJVM   at upickle.Types$Reader$$anon$2.apply(Types.scala:103)
webappJVM   at upickle.Implicits$$anonfun$CaseR$1.applyOrElse(Implicits.scala:90)
webappJVM   at upickle.Implicits$$anonfun$CaseR$1.applyOrElse(Implicits.scala:89)
webappJVM   at upickle.Types$Reader$$anon$2.apply(Types.scala:113)
webappJVM   at upickle.Types$Reader$$anon$2.apply(Types.scala:103)
webappJVM   at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123)
webappJVM   at upickle.Types$Reader$$anon$2.applyOrElse(Types.scala:103)
webappJVM   at upickle.Implicits$Internal$$anon$1.apply(Implicits.scala:53)
webappJVM   at upickle.Implicits$Internal$$anon$1.apply(Implicits.scala:50)
webappJVM   at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123)
webappJVM   at upickle.Implicits$Internal$$anon$1.applyOrElse(Implicits.scala:50)
webappJVM   at upickle.Types$Reader$$anon$2.apply(Types.scala:113)
webappJVM   at upickle.Types$Reader$$anon$2.apply(Types.scala:103)
webappJVM   at upickle.Types$class.readJs(Types.scala:160)
webappJVM   at upickle.default$.readJs(Api.scala:25)
webappJVM   at upickle.Types$class.read(Types.scala:156)
webappJVM   at upickle.default$.read(Api.scala:25)
webappJVM   at ch.epfl.scala.index.data.ProjectProtocol$ProjectAs$.as(package.scala:15)
webappJVM   at ch.epfl.scala.index.data.ProjectProtocol$ProjectAs$.as(package.scala:13)
webappJVM   at com.sksamuel.elastic4s.RichSearchHit.as(RichSearchResponse.scala:99)
webappJVM   at com.sksamuel.elastic4s.RichSearchResponse$$anonfun$as$1.apply(RichSearchResponse.scala:32)
webappJVM   at com.sksamuel.elastic4s.RichSearchResponse$$anonfun$as$1.apply(RichSearchResponse.scala:32)
webappJVM   at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
webappJVM   at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
webappJVM   at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33)
webappJVM   at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:186)
webappJVM   at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
webappJVM   at scala.collection.mutable.ArrayOps$ofRef.map(ArrayOps.scala:186)
webappJVM   at com.sksamuel.elastic4s.RichSearchResponse.as(RichSearchResponse.scala:32)
webappJVM   at ch.epfl.scala.index.server.ApiImplementation.ch$epfl$scala$index$server$ApiImplementation$$$anonfun$2(ApiImplementation.scala:40)
webappJVM   at ch.epfl.scala.index.server.ApiImplementation$lambda$$find$1.apply(ApiImplementation.scala:35)
webappJVM   at ch.epfl.scala.index.server.ApiImplementation$lambda$$find$1.apply(ApiImplementation.scala:35)
webappJVM   at scala.util.Success$$anonfun$map$1.apply(Try.scala:237)
webappJVM   at scala.util.Try$.apply(Try.scala:192)
webappJVM   at scala.util.Success.map(Try.scala:237)
webappJVM   at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:237)
webappJVM   at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:237)
webappJVM   at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)
webappJVM   at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:55)
webappJVM   at akka.dispatch.BatchingExecutor$BlockableBatch$$anonfun$run$1.apply$mcV$sp(BatchingExecutor.scala:91)
webappJVM   at akka.dispatch.BatchingExecutor$BlockableBatch$$anonfun$run$1.apply(BatchingExecutor.scala:91)
webappJVM   at akka.dispatch.BatchingExecutor$BlockableBatch$$anonfun$run$1.apply(BatchingExecutor.scala:91)
webappJVM   at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:72)
webappJVM   at akka.dispatch.BatchingExecutor$BlockableBatch.run(BatchingExecutor.scala:90)
webappJVM   at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39)
webappJVM   at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:405)
webappJVM   at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
webappJVM   at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
webappJVM   at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
webappJVM   at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)

api to receive new pom

duplicate #27

Partial Update of Data

created_after https://bintray.com/docs/api/#_file_search_by_name (6f01f12)
update elasticsearch without loosing information

UI: Display all project versions on project page

@MasseGuillaume will show how to get all project versions from backend for use by front-end

sort releases by version

For scala-pickling for example, the list of version numbers is out of order:

The current version should be v.0.10.1. As-is, the order in the above list doesn't make a whole lot of sense.

notify new release via gitter.im

UI: add keywords to UI

Deploy to Alaska

Get dependencies on EPFL machine

Edit Project

After being logged in a user can edit his project info:

accessible fields:

Project
Artifact
default artifact #158
#100 scaladoc link

dropdown multiselect for keywords
input box for other infos
dropdown for artifact deprecation

Backend

keywords dropdown api
deprecation dropdown api
update api

We can push to a central Twitter account.
We can let the project owner customize a tweet template:

For example:

@playframework just released <artifact-name> <version> for <Scala target> 
<link to scaladex>

Way for companies to endorse projects

API

JSON APIs for accessing Scaladex data

Joris's needs

In the future: (to keep in mind)

Felix will potentially need for linking dottydoc
Adriaan for community build

Search relevance

UI: Contribution policy badges

When clicked, should take you to project's CONTRIBUTING.md file (if it exists)

https://github.com/blog/1184-contributing-guidelines

sbt publish should update/notify scalaindex

@raulraja: contribute to sbt to make sure publish notify the Scala Index

We could use various social vectors such as mailing list, slack,gitter, irc, twitter to broadcast a library release.

Example for twitter:

@scala_index: @shapeless 2.3.1 is released http://index.scala-lang.org/typelevel/shapeless

Definition: "Lightweight, modular, and extensible library for functional programming."
Website: "http://typelevel.org/cats/"
Stars/Fork: 1,075/24
Readme
Contributors (+Avatar, etc)