techforpalestine / palestine-datasets Goto Github PK
View Code? Open in Web Editor NEWThe human toll of Israel's ongoing genocide in names & numbers. Use the data from our APIs to tell their story.
Home Page: https://data.techforpalestine.org
The human toll of Israel's ongoing genocide in names & numbers. Use the data from our APIs to tell their story.
Home Page: https://data.techforpalestine.org
It's confusing that they're included since it's unclear whether they drive anything in the deployed site, or what controls updating them.
In order to gitignore everything under site/src/generated, we'll need to have a setup script for local development that initializes these files otherwise there will be import errors.
Not having these files to "fallback to" will also avoid the issue just encountered today where gen-summaries was accidentally removed from pre-build and we were showing stale summary values from January....
Right now I have to run the script locally to generate the datasets because they need to talk to my google sheet using an API key. Moving this into CI will allow others to run the same generating script (and also make my life a bit easier).
Maybe Microsoft one day take an alarm from Isreal then delete all these repos and all this data in seconds :/
https://discord.com/channels/1186702814341234740/1201330548933673010
we want to capture the following from UN OCHA flash updates for the West Bank since Oct 7:
example report:
https://discord.com/channels/1186702814341234740/1201330548933673010/1202239025101156533
example parts of that report with the above mentioned data:
Violence and casualties (West Bank)
On 17 January, Israeli forces killed six Palestinians, including two children, in an airstrike that they carried out while operating in Tulkarm Refugee Camp. In the early morning, Israeli forces raided the camp, where clashes erupted between Israeli forces and Palestinians, including an exchange of gunfire and the use of explosive devices by the latter was reported. Subsequently, an Israeli airstrike targeted a group of Palestinians, killing four, including two children. During the operation, seven Palestinians, including two PCRS paramedics, and one Israeli soldier had been injured. An ambulance was severely damaged by shrapnel and two Palestine Red Crescent Society (PRCS) paramedics were detained by Israeli forces. Israeli forces bulldozed several roads inside and the camp, surrounded the hospitals in Tulkarm city and obstructed the movement of medical crews. During the raid, Israeli forces opened fire at a vehicle, killing one Palestinian and injuring another. An additional Palestinian was shot with live ammunition and was later pronounced dead.
On 17 January, Israeli forces killed five Palestinian in an airstrike on a vehicle near the entrance of Balata Refugee Camp, Nablus city. Four of the bodies are being withheld by Israeli forces. The fifth body was incinerated by the airstrike. Israeli forces reportedly prevented PRCS ambulances from accessing the location and opened fire at them. According to the Israeli authorities, a vehicle that carried Palestinians accused of conducting attacks against Israelis was targeted. Two hours before the airstrike, Israeli forces conducted an operation in Balata Refugee Camp, in which they raided a number of Palestinian homes. Clashes between Israeli forces and Palestinians also erupted during the operation, including the throwing of pipe bombs by the latter.
Since 7 October 2023 and as of 17 January 2024, 355 Palestinians have been killed, including 90 children, across the West Bank, including East Jerusalem. Additionally, two Palestinians from the West Bank were killed while carrying out an attack in Israel on 30 November. Of the fatalities in the West Bank (355), 346 were killed by Israeli forces, eight by Israeli settlers and one by either Israeli forces or settlers. So far in 2024 (as of 17 January), 46 Palestinians, including nine children, have been killed. The number of Palestinians killed in the West Bank, including East Jerusalem, in 2023 (507) marks the highest number of Palestinians killed in the West Bank since OCHA started recording casualties in 2005.
Since 7 October 2023 and as of 17 January 2024, five Israelis, including four members of Israeli forces, have been killed in Palestinian attacks in the West Bank, including East Jerusalem. Four Israelis were killed in an attack carried out by Palestinians from the West Bank in West Jerusalem (one of the four was killed by Israeli forces who misidentified him) on 30 November 2023. Another Israeli woman was killed in another attack perpetrated by Palestinians in Israel on 15 January 2024. The number of Israelis killed in the West Bank and Israel in 2023 in attacks perpetrated by Palestinians from the West Bank (36) was the highest since OCHA started recording casualties in 2005.
Since 7 October 2023 and as of 17 January 2024, 4,234 Palestinians, including 643 children, have been injured in the West Bank, including East Jerusalem. Of them, 4,104 have been injured by Israeli forces, 109 by settlers and 21 by either Israeli forces or settlers. Of the total injuries, 53 per cent were reported in the context of search-and-arrest and other operations, 35 per cent in demonstrations and 8 per cent during settler attacks against Palestinians. Some 33 per cent of those injuries have been caused by live ammunition, compared with 9 per cent in the first nine months of 2023.
Settler Violence
Since 7 October 2023 and as of 17 January 2024, OCHA recorded 431 Israeli settler attacks against Palestinians, resulting in Palestinian casualties (41 incidents), damage to Palestinian-owned property (337 incidents), or both casualties and damage to property (53 incidents). This reflects a daily average of four incidents since 7 October 2023 until 17 January 2024.
One-third of the settler attacks against Palestinians after 7 October 2023 have involved firearms, including shootings and threats of shootings. In nearly half of all recorded incidents after 7 October, Israeli forces were either accompanying or reported to be supporting the attackers.
In 2023, 1,229 incidents involving Israeli settlers in the West Bank, including East Jerusalem (with or without Israeli forces), resulted in Palestinian casualties, property damage or both. Some 913 of these incidents resulted in damage, 163 resulted in casualties and 153 resulted in both. This is the highest number of settler attacks against Palestinians in any given year since OCHA started recording incidents involving settlers in 2006.
Displacement (West Bank)
From 7 October 2023 and as of 17 January 2024, at least 198 Palestinian households comprising 1,208 people, including 586 children, have been displaced amid settler violence and access restrictions. The displaced households are from at least 15 herding/Bedouin communities. More than half of the displacements occurred on 12, 15, and 28 October, affecting seven communities. The displacement toll since 7 October 2023, represents 78 per cent of all displacement reported due to settler violence and access restrictions since 1 January 2023 (1,539 people, including 756 children).
From 7 October 2023 and as of 17 January 2024, 460 Palestinians, including 227 children, have been displaced, following the demolition of their homes, due to lack of Israeli-issued building permits in Area C and East Jerusalem, which are almost impossible to obtain.
A total of 19 homes have been demolished and 95 Palestinians, including 42 children, displaced due to punitive demolitions from 7 October 2023 and as of 17 January 2024. The numbers exceed those reported in the first nine months of the same year, during which 16 homes were punitively demolished and 78 people displaced.
From 7 October 2023 and as of 17 January 2024, 602 Palestinians, including 263 children, have been displaced, following the destruction of 94 homes during other operations carried out by Israeli forces across the West Bank. About 94 per cent of the displacement was reported in the refugee camps of Jenin, and in Nur Shams and Tulkarm, both in Tulkarm. This represents 65 per cent of all displacement reported due to the destruction of homes during Israeli military operations since January 2023 (908 people).
The ability to search for names phonetically (e.g., with Soundex) would make these databases much more accessible to non-Arabic speakers.
I found a mapping of Arabic characters to Soundex codes here: https://www.codeproject.com/Articles/26880/Arabic-Soundex/ Could this perhaps be used as a starting point?
In another repo PR, aborazmeh shared their in-progress translation work: aborazmeh/awesome-palestine#36 (comment) and we should pull their list, break the names into whole segments, normalize the arabic segments, and compare those translations with our own lookups for consistency, and:
Hi, I'm Arief from Indonesia and I built the https://remembergaza.id website using Palestine Datasets. The website displays all the identified victims in Gaza using the Killed in Gaza dataset. I would love to add this website to the Example section.
After looking at the repository, I think I can append a new ## Killed in Gaza
section in examples.mdx
here.
Please let me know if I can proceed. Thanks.
In backfilling some missing values that were reported for the martyr breakdown (children, women), I noticed the ext_* values were a bit off relative to the reported increments to the total for the day, so we should try to align those as best as possible. This involves backfilling some "corrected" values for those estimates on unreported days
Another PDF was released in early May that seems to include an additional 4k names. The list no longer includes the source column but otherwise seems similar. Will need some changes to our existing scripts to intake.
Great work. Thank you!
I used the data you provide to make an animated visualization (bar chart race) for the daily casualties.
You can find it here:
https://hatemhosny.github.io/conflict-casualties/
This is a playground in case you want to make some edits:
https://livecodes.io/?x=id/5vjcrw2xdj8
I'm open for suggestions or ideas.
I found out recently that Cloudflare Pages has an upper limit of 20,000 files for any deployment and since we have upwards of 14k names in our current Killed in Gaza list (which we expect to double...), and we write a JSON file for each person, we will surpass the limit in the near future. These links were previously published in our docs as an API resource people could use, but I removed those docs before we had our PR launch to leave open the option to revert this approach. Looking at analytics, it looks like only the website search tool is making these requests, so we can remove them safely (treating as an undocumented/internal API).
Suggest we move to a model where the existing search index files point to pages instead of individual JSON records. Each page could have ~50 names and the index would provide the page ID & index offset inside the page for easy access.
The build setup probably isn't super clear to folks and it'll help to understand how the workflows work if anyone wants to contribute.
Can also rough in a "contributing FAQ" with steps on how to make changes to specific datasets. These docs can show up on the website under a contributing section.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.