Comments (4)
Here's a project description from the VPS semester of code that I wrote:
User Interface for the Distributed Release Audit Tool (DRAT)
The Distributed Release Audit Tool (DRAT) improves over the Apache RAT code audit tool in several ways. RAT is a command line tool and Java API and Maven plugin that audits a code base and its declared OSS licenses - if you say it's Apache2, RAT will check whether or not your source is Apache2 and produce a report that states what files are/aren't and why.
RAT has several problems, namely:
It doesn't scale to large code bases - running it on a 25k file and 10M LOC code base ran for ~4 weeks on a normal Linux server with 5GB memory and tons of hard disk and modern CPUs.
RAT's crawler is rudimentary and you have to use explicit white/black lists on what files to avoid or else it will be checking binary files for licenses.
RAT doesn't produce incremental output. It either completes and generates a log, or it doesn't.
DRAT improves upon RAT in several ways namely by addressing all of the above concerns. You can find DRAT here: https://github.com/chrismattmann/drat/
DRAT is a Map Reduce version of RAT using Apache Tika to automatically sort and classify the code base files; Apache OODT to index metadata and Tika information about those code files into Apache Solr; and OODT to produce a Map Reduce workflow that runs RAT incrementally on k-sized chunks of same-MIME-typed files (detected by Tika) and then producing incremental, per type logs, and then aggregating and reducing them into a combined log at the end.
DRAT currently has support for command line interaction, but no GUI. We need a GUI for DRAT that brings in neat visual interfaces like D3.js to show RAT log historgrams and code/source file reports and mappings. We need a search box in which a user inputs a URL pointing at a code base and the backend services for DRAT are invoked.
from drat.
Presently looking into Bootstrap using either JSPs or Servlets able to query Solr and populate D3.js graphs and charts.
from drat.
great to hear @ericmarcincuddy
from drat.
I have some students at USC also working on this project now. I'll include you on the emails.
from drat.
Related Issues (20)
- Proteus doesn't index HOT 2
- Finish hooking up DRAT to Travis HOT 1
- Cypress Tests For Proteus
- Tool-tips for the visualizations to help newbies
- Drat Viz page refreshes too often
- Consider project groupings
- Consider a search bar for projects in project view viz HOT 3
- Consider reduction in project viz refresh on main page
- Consider highlighting the "Unknown" licenses in the audit view
- Consider using a log scale for the bar charts
- Hashmap exception when reducing
- PGE tries to run wrong RAT version HOT 1
- remove shopt from scripts HOT 1
- Create an issue and pull request templates HOT 3
- gitlab build chain for build and docker image
- Upgrade to Apache OODT 1.9 release HOT 1
- Change Maven Module prefix names from dms-* to drat-*
- DRAT updates to make it work with OODT 1.9 HOT 1
- Fix security issue in set-value
- Update logging to slf4j/log4j to match with OODT 1.9 onwards
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from drat.