Code Monkey home page Code Monkey logo

palestine-datasets's People

Contributors

ariefrahmansyah avatar benaissazaki avatar helayoty avatar janajri avatar jkoshy avatar molotfi5567 avatar ninja-16361 avatar saadi42 avatar sterlingwes avatar webzetetic avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

palestine-datasets's Issues

Remove all generated files from source control

It's confusing that they're included since it's unclear whether they drive anything in the deployed site, or what controls updating them.

In order to gitignore everything under site/src/generated, we'll need to have a setup script for local development that initializes these files otherwise there will be import errors.

Not having these files to "fallback to" will also avoid the issue just encountered today where gen-summaries was accidentally removed from pre-build and we were showing stale summary values from January....

Move generating daily updates to CI

Right now I have to run the script locally to generate the datasets because they need to talk to my google sheet using an API key. Moving this into CI will allow others to run the same generating script (and also make my life a bit easier).

I'm very weird!

Maybe Microsoft one day take an alarm from Isreal then delete all these repos and all this data in seconds :/

Add West Bank "attack by IDF/Settlers" numbers to daily dataset (since Oct 7)

https://discord.com/channels/1186702814341234740/1201330548933673010

we want to capture the following from UN OCHA flash updates for the West Bank since Oct 7:

  • killed
  • cumulative killed
  • injured
  • cumulative injured
  • children killed
  • children injured
  • number of settler attacks
  • displaced Palestinians (preferably individuals, not household number)

example report:

https://discord.com/channels/1186702814341234740/1201330548933673010/1202239025101156533

example parts of that report with the above mentioned data:

Violence and casualties (West Bank)

On 17 January, Israeli forces killed six Palestinians, including two children, in an airstrike that they carried out while operating in Tulkarm Refugee Camp. In the early morning, Israeli forces raided the camp, where clashes erupted between Israeli forces and Palestinians, including an exchange of gunfire and the use of explosive devices by the latter was reported. Subsequently, an Israeli airstrike targeted a group of Palestinians, killing four, including two children. During the operation, seven Palestinians, including two PCRS paramedics, and one Israeli soldier had been injured. An ambulance was severely damaged by shrapnel and two Palestine Red Crescent Society (PRCS) paramedics were detained by Israeli forces. Israeli forces bulldozed several roads inside and the camp, surrounded the hospitals in Tulkarm city and obstructed the movement of medical crews. During the raid, Israeli forces opened fire at a vehicle, killing one Palestinian and injuring another. An additional Palestinian was shot with live ammunition and was later pronounced dead. 

On 17 January, Israeli forces killed five Palestinian in an airstrike on a vehicle near the entrance of Balata Refugee Camp, Nablus city. Four of the bodies are being withheld by Israeli forces. The fifth body was incinerated by the airstrike. Israeli forces reportedly prevented PRCS ambulances from accessing the location and opened fire at them. According to the Israeli authorities, a vehicle that carried Palestinians accused of conducting attacks against Israelis was targeted. Two hours before the airstrike, Israeli forces conducted an operation in Balata Refugee Camp, in which they raided a number of Palestinian homes. Clashes between Israeli forces and Palestinians also erupted during the operation, including the throwing of pipe bombs by the latter.  

Since 7 October 2023 and as of 17 January 2024, 355 Palestinians have been killed, including 90 children, across the West Bank, including East Jerusalem. Additionally, two Palestinians from the West Bank were killed while carrying out an attack in Israel on 30 November. Of the fatalities in the West Bank (355), 346 were killed by Israeli forces, eight by Israeli settlers and one by either Israeli forces or settlers. So far in 2024 (as of 17 January), 46 Palestinians, including nine children, have been killed. The number of Palestinians killed in the West Bank, including East Jerusalem, in 2023 (507) marks the highest number of Palestinians killed in the West Bank since OCHA started recording casualties in 2005. 

Since 7 October 2023 and as of 17 January 2024, five Israelis, including four members of Israeli forces, have been killed in Palestinian attacks in the West Bank, including East Jerusalem. Four Israelis were killed in an attack carried out by Palestinians from the West Bank in West Jerusalem (one of the four was killed by Israeli forces who misidentified him) on 30 November 2023. Another Israeli woman was killed in another attack perpetrated by Palestinians in Israel on 15 January 2024. The number of Israelis killed in the West Bank and Israel in 2023 in attacks perpetrated by Palestinians from the West Bank (36) was the highest since OCHA started recording casualties in 2005. 

Since 7 October 2023 and as of 17 January 2024, 4,234 Palestinians, including 643 children, have been injured in the West Bank, including East Jerusalem. Of them, 4,104 have been injured by Israeli forces, 109 by settlers and 21 by either Israeli forces or settlers. Of the total injuries, 53 per cent were reported in the context of search-and-arrest and other operations, 35 per cent in demonstrations and 8 per cent during settler attacks against Palestinians. Some 33 per cent of those injuries have been caused by live ammunition, compared with 9 per cent in the first nine months of 2023. 

Settler Violence

Since 7 October 2023 and as of 17 January 2024, OCHA recorded 431 Israeli settler attacks against Palestinians, resulting in Palestinian casualties (41 incidents), damage to Palestinian-owned property (337 incidents), or both casualties and damage to property (53 incidents). This reflects a daily average of four incidents since 7 October 2023 until 17 January 2024. 

One-third of the settler attacks against Palestinians after 7 October 2023 have involved firearms, including shootings and threats of shootings. In nearly half of all recorded incidents after 7 October, Israeli forces were either accompanying or reported to be supporting the attackers. 

In 2023, 1,229 incidents involving Israeli settlers in the West Bank, including East Jerusalem (with or without Israeli forces), resulted in Palestinian casualties, property damage or both. Some 913 of these incidents resulted in damage, 163 resulted in casualties and 153 resulted in both. This is the highest number of settler attacks against Palestinians in any given year since OCHA started recording incidents involving settlers in 2006. 

Displacement (West Bank) 

From 7 October 2023 and as of 17 January 2024, at least 198 Palestinian households comprising 1,208 people, including 586 children, have been displaced amid settler violence and access restrictions. The displaced households are from at least 15 herding/Bedouin communities. More than half of the displacements occurred on 12, 15, and 28 October, affecting seven communities. The displacement toll since 7 October 2023, represents 78 per cent of all displacement reported due to settler violence and access restrictions since 1 January 2023 (1,539 people, including 756 children).  

From 7 October 2023 and as of 17 January 2024, 460 Palestinians, including 227 children, have been displaced, following the demolition of their homes, due to lack of Israeli-issued building permits in Area C and East Jerusalem, which are almost impossible to obtain. 

A total of 19 homes have been demolished and 95 Palestinians, including 42 children, displaced due to punitive demolitions from 7 October 2023 and as of 17 January 2024. The numbers exceed those reported in the first nine months of the same year, during which 16 homes were punitively demolished and 78 people displaced.  

From 7 October 2023 and as of 17 January 2024, 602 Palestinians, including 263 children, have been displaced, following the destruction of 94 homes during other operations carried out by Israeli forces across the West Bank. About 94 per cent of the displacement was reported in the refugee camps of Jenin, and in Nur Shams and Tulkarm, both in Tulkarm. This represents 65 per cent of all displacement reported due to the destruction of homes during Israeli military operations since January 2023 (908 people).  

Add remembergaza.id in Killed in Gaza example

Hi, I'm Arief from Indonesia and I built the https://remembergaza.id website using Palestine Datasets. The website displays all the identified victims in Gaza using the Killed in Gaza dataset. I would love to add this website to the Example section.

After looking at the repository, I think I can append a new ## Killed in Gaza section in examples.mdx here.

Please let me know if I can proceed. Thanks.

Cleanup daily extrapolated dataset

In backfilling some missing values that were reported for the martyr breakdown (children, women), I noticed the ext_* values were a bit off relative to the reported increments to the total for the day, so we should try to align those as best as possible. This involves backfilling some "corrected" values for those estimates on unreported days

fix(search): switch to paged person records from individual

I found out recently that Cloudflare Pages has an upper limit of 20,000 files for any deployment and since we have upwards of 14k names in our current Killed in Gaza list (which we expect to double...), and we write a JSON file for each person, we will surpass the limit in the near future. These links were previously published in our docs as an API resource people could use, but I removed those docs before we had our PR launch to leave open the option to revert this approach. Looking at analytics, it looks like only the website search tool is making these requests, so we can remove them safely (treating as an undocumented/internal API).

Suggest we move to a model where the existing search index files point to pages instead of individual JSON records. Each page could have ~50 names and the index would provide the page ID & index offset inside the page for easy access.

Document architecture / how to contribute

The build setup probably isn't super clear to folks and it'll help to understand how the workflows work if anyone wants to contribute.

Can also rough in a "contributing FAQ" with steps on how to make changes to specific datasets. These docs can show up on the website under a contributing section.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.