Red Flower Hell in Minecraft MALMÖ

NB4tf4i's Red Flowers (Red Flower Hell) - DEAC-Hackers Battle Royale Arena

HI agents: initial hack: 18, world record: 46 poppies
SW agents: initial hack: 13, world record: 53 poppies
AI agents: there are no such agents at this moment, initial hack: -, world record: - poppies
AGI agents: there are no such agents at this moment, initial hack: -, world record: - poppies

Red Flower Hell

Nowadays the key players in the artificial intelligence industry have their own platform for AGI research that is typically built on some well-known current or former game title. For example, Google uses the Quake III Arena and Star Craft II. Microsoft uses Minecraft for similar research purpose [1].

The Project MALMÖ is a Minecraft mod created by the Microsoft. Now we have started to use MALMÖ in education of programming. Then based on the experience gained with this we would like to use it in AGI research too. For this purpose we have begun to experiment with our own series of competitions called Red Flower Hell. The specific purpose of this challenge series is to collect as many red flowers as possible before the lava flows down the hillside as it can be seen in the following figure.

Human Intelligence agents (HI agents)

In the elements of Red Flower Hell series we are going to develop intelligent agents to collect poppies. After this we would also like develop AGI agents in this environment. It is therefore essential to know that how many poppies can a human player collect?

nb4tf4i.xml
nb4tf4i_red_flower_hell_basic_human.py

HI Agents Results

initial hack: 18, N. Bátfai
world record: 46 poppies, I. Horváth

Software agents (SW agents)

These programs do not contain the usual MI solutions (such as graph searching or Q-learning), but only naive heuristic algorithms.

Family circle (with my children)

The first experiments with MALMÖ we had taken in our immediate family circle as we did with, for example, project BrainB [1] or SMNIST [2]. We have played with cheating (using ObservationFromGrid) and without cheating as well.

Study circles (for primary and secondary school pupils and students)

First circle

Demo

nb4tf4i.xml
nb4tf4i_red_flower_hell_basic.py

Modify the initial loop

# Loop until mission ends:
while world_state.is_mission_running:
    print("--- nb4tf4i arena -----------------------------------\n")
    self.agent_host.sendCommand( "move 1" )
    time.sleep(.5)            
    self.agent_host.sendCommand( "turn 1" )
    time.sleep(.5)
    world_state = self.agent_host.getWorldState()

to rotate Steve at half speed.

Modify the loop to move Steve forward and backward.
Modify the loop to move Steve forward by turning right and left (zig-zag).
Modify the loop to walk Steve around in the arena.
Modify the loop to move up Steve in spiral line in the arena until he reach the lava.

Second circle

Demo

nb4tf4i_d.xml
nb4tf4i_red_flower_hell_basic_d.py

# Loop until mission ends:
while world_state.is_mission_running:
    print("--- nb4tf4i arena -----------------------------------\n")
    self.agent_host.sendCommand( "move 1" )
    time.sleep(.5)            
    self.agent_host.sendCommand( "move 1" )
    time.sleep(.5)            
    self.agent_host.sendCommand( "move 1" )
    time.sleep(.5)            
    self.agent_host.sendCommand( "turn 1" )
    time.sleep(.5)
    world_state = self.agent_host.getWorldState()

Let's do the same task as in the first circle but now with using discrete motion commands.

Third circle

Programming task
nb4tf4i_red_flower_hell_basic_d_sense.py

class Steve:
    def __init__(self, agent_host):
        self.agent_host = agent_host
        self.x = 0
        self.y = 0
        self.z = 0        
        self.yaw = 0
        self.pitch = 0        

    def run(self):
        world_state = self.agent_host.getWorldState()
        # Loop until mission ends:
        while world_state.is_mission_running:
            print("--- nb4tf4i arena -----------------------------------\n")
            if world_state.number_of_observations_since_last_state != 0:

                sensations = world_state.observations[-1].text
                print("    sensations: ", sensations)                
                observations = json.loads(sensations)
                nbr3x3x3 = observations.get("nbr3x3", 0)
                print("    3x3x3 neighborhood of Steve: ", nbr3x3x3)

                if "Yaw" in observations:
                    self.yaw = int(observations["Yaw"])
                if "Pitch" in observations:
                    self.pitch = int(observations["Pitch"])
                if "XPos" in observations:
                    self.x = int(observations["XPos"])
                if "ZPos" in observations:
                    self.z = int(observations["ZPos"])        
                if "YPos" in observations:
                    self.y = int(observations["YPos"])  

                print("    Steve's Coords: ", self.x, self.y, self.z)        
                print("    Steve's Yaw: ", self.yaw)        
                print("    Steve's Pitch: ", self.pitch)

Modify this code to print what Steve sees.

Hint:

if "LineOfSight" in observations:
    lineOfSight = observations["LineOfSight"]
    self.lookingat = lineOfSight["type"]
print("    Steve's <): ", self.lookingat)

Then modify the code further to print a debug message if Steve sees a red flower.
A solution can be seen in this video: https://youtu.be/mT9FOzzSjUI
Finally, modify the code to mine a red flower.

Fourth circle

Programming task: Steve should go up to the lava then come back down to the starting level walking ahead of the lava.

Fifth circle

Let's do the same task as in the previous circle but now with using 5x5x5 or 7x7x7 grid of blocks in ObservationFromGrid.

Courses (for university students)

In these courses students can earn extra points by solving MALMÖ based programming tasks.

High-level programming languages I

Syllabus, lectures, laboratory work, community.

There are usually roughly 130 students in the High-level programming languages I lecture. This picture was taken on Wed, 19 Feb 2020.

The purpose of the following contests (Red Flower Hell I.-IV.) is to gain experience in agent programming. There is no reward or prize. We play the game for the game's sake.

Red Flower Hell I.

10 Feb - 2 Mar
Using ObservationFromGrid has already been a cheating in itself. But in this first round there are no rules, anything is allowed, for example the students can use directly the coordinates of flowers from mission XML file with the teleport command... and so on.

How to participate? Comment the link of your YouTube video to the post: https://www.facebook.com/groups/udprog/permalink/1337108209810398/

Results

initial hack: 13 poppies, Bátfai, N. (without AbsoluteMovementCommand)
first place: 58 poppies, there was a dead heat for first place between Pusztai, R. (with trivial teleporting), Hajdu, B. (with using water), Nagy, V., Kusmiczki, B. & Nagy, E., Bence, C. & Barna, B., Kálny, Z. & Szilágy Z., Salánki, L. & Kovács, I., Nagy, L. E. & Tódor, G., Takács, B., Szabó, B. & Pete, B., Hosszú, Sz., Semendi, Á. and Béres, M. (with trivial teleporting)
second place: 57, Kántor, D.
third place: -

Summary: the purpose of this round was to install and learn about MALMÖ.

Red Flower Hell II.

2 Mar - 23 Mar

Based on experience gained in the first round, the following are prohibited:

using the data of the mission XML file
using absolute movement commands
modifying the mission XML file
changing the game mode
gaining mouse control

How to participate? Comment the link of your YouTube video to the post: https://www.facebook.com/groups/udprog/permalink/1342653805922505/

Results

initial hack: 14 poppies, Bátfai, N.
first place: 53 poppies, Káplár, I. & Halász, D.
second place: 41 poppies, Kiss, K. & Hegedűs, P.
third place: 39 poppies, Hajdu, B., Takács, B. & Szabó, D.
4-th place: 37 poppies, Káplár, I. et al.
5-th place: 28 poppies, Szoboszlai, I. & Kiss, D.
6-th place: 26 poppies, Nagy, E. & Kusmiczki, B.
7-th place: 24 poppies, Bátfai, N.
8-th place: 23 poppies, Kántor, D., Tóth, F.
9-th place: 22 poppies, Kiss, D.
10-th place: 21 poppies, Hajdu, B. & György, D.
11-th place: 20 poppies, Szoboszlai, I., Zselenák, F., Puskás, P.
12-th place: 19 poppies, Bátfai, N., source code available
13-th place: 17 poppies, Olasz, Zs. & Ignácz, M.

Red Flower Hell III.

23 Mar - 6 Apr

Qualification limit: 25 poppies. The deadline for submission of the source code of your SF agent is 1 Apr. There will be online qualifiers followed by ~~offline~~ (online because coronavirus) finals at the spring school holidays. Until now the red flowers have always been placed to the same place. In the finals, the locations of the red flowers will be re-generated. (For example, try this mission XML file: nb4tf4i_d_2.xml )

How to participate? Comment the link of your YouTube video to the post: https://www.facebook.com/groups/udprog/permalink/1359276454260240/

Qualification Results

initial hack: 28 poppies, Bátfai, N., source code available
first place: 50 poppies, Káplár, I. & Halász, D.
second place 48 poppies, Kiss, K. & Hegedűs, P.
third place 44 poppies, Hajdu, B. & Dávid, Gy.
4-th place 43 poppies, Kálmán, I.& Katona, A.
5-th place 40 poppies, Szabó, B. & Pete, B.
6-th place 38 poppies, Hosszú, Gy. & Zselenák, F.
7-th place 37 poppies, Hajdu, B. & Dávid, Gy.
8-th place 35 poppies, Takács, B. & Szabó, D.
9-th place 34 poppies, Kálmán, I. & Katona, A.
10-th place 33 poppies, Nagy, L. E. & Tódor, G.
11-th third place 32 poppies, Kántor, D.
12-th third place 31 poppies, Hosszú, Sz., Czövek, B. & Barna, B.
13-th third place 30 poppies, Szilágyi, Z. & Kálny, Z., Koncz, B., Bukovinszki, M., Geszterédi, J. & Gyulai, D., Puskás, P., Puzsár, B. & Gyulai, D., Nagy, G. & Szilágyi, M., Nagy, E. & Kusmiczki, B., Szoboszlai, I. & Kiss, D.
14-th third place 29 poppies, Hosszú Gy. & Zselenák F., Kántor, D., Koncz, B., Szimeonov, V., Kalló, Gy. D. & Minya, Á., Pintér, B. & Somogyi, V., Jakab, A., Szoboszlai, I. & Kiss, D.
15-th third place 28 poppies, Bátfai, N. B., Szoboszlai, I. & Kiss, D., Pálffy, V., Szilágyi, Z. & Kálny, Z., Nagy, E. & Kusmiczki, B.
16-th third place 27 poppies, Tutor, T. & Czanik Tony, A.
17-th third place 26 poppies, Szabó, B. & Pete, B., Bukovinszki, M.

Final Results

Day 1, Day 2, Day 3,
source codes available
first place: 46 poppies, there was a dead heat for first place between Káplár, I. & Halász, D. and Kiss, K. & Hegedűs. P.
second place: 43 poppies, Hajdu, B. & Dávid, Gy.
third place 40 poppies, Szabó, B. & Pete, B.
4-th place 38 poppies, Nagy, L. E. & Tódor, G.
5-th place 36 poppies, Kálmán, I. & Katona, A.
6-th place 34 poppies, Takács, B. & Szabó, D.
7-th place 22 poppies, Kántor, D.
8-th place 11 poppies, Hosszú, Gy. & Zselenák, F.

Red Flower Hell IV. - "RFH Rudolph"

13 Apr - 8 May

Mission XML files:

Hard League nb4tf4i_d4_Rudolf_hard.xml
Soft League nb4tf4i_d4_Rudolf_soft.xml

Qualification limit: (hard: 5/soft: 9) poppies. The deadline for submission of the source code of your SF agent is 8 May. In this round the full arena will be re-generated: not only the coords of the red flowers but also the walls of the hillside will change as it can be seen in the following figure.

Rudolf has been chosen as the default arena for RFH IV.

How to participate? Comment the link of your YouTube video to the post: https://www.facebook.com/groups/udprog/permalink/1380895935431625/

HI Agents Results (Human)

initial hack: Please use this source for measuring
current first place: 38 poppies, Aranyi, Á.
current second place: 36 poppies, Zsabej, M., Szabó, B.
current third place: 34 poppies, Szoboszlai, I.
4-th place: 30 poppies, Geszteredi, J., Gyulai, D.
5-th place: 28 poppies, Takács, B., Tóth, F.
6-th place: 27 poppies, Bartha, Z.
7-th place: 26 poppies, Kiss, D.
8-th place: 23 poppies, Puskás, P., Vékony, O.
9-th place: 22 poppies, Tari, L.
10-th place: 19 poppies, Papp, Cs.

Qualification Results (Hard)

initial hack: 5 poppies, Bátfai, N. & Bátfai, N. B., source code available
first place: 14 poppies, Osztós, Zs.
second place: 10 poppies, Aranyi, Á. (Py)
third place: 9 poppies, Tutor, T. & Czanik, A. (Py)
4-th place: 8 poppies, Szakács, Á. & Fiedler, N. (C++), Tutor, T. & Czanik, A., Aranyi, Á. (C++)
5-th place: 7 poppies, Tóth, F. (C++), Tari, L., Naghi, P. & Sándor, M., Brudnyák, B. (Py), Takács, B. Dávid Kiss, D. & Vékony, O. (C++)
6-th place: 6 poppies, Bartha, Z. (Py), Barna, B.
7-th place: 5 poppies, Takács, B. & Vékony, O (Py), Nagy, E. & Kusmiczki, B., Szoboszlai, I., Kovács, I., Szabó, P., Tóth, F. (Py), Veress, G. & Nyika, B. (Py), Hegedűs, P. (Py), Sápi, G. (Py), Orosz, R., Puskás, P., Gyulai, D.

Qualification Results (Soft)

first place: 13 poppies, Takács, B. & Vékony, O (Py)
second place: 9 poppies, Takács, B. Dávid Kiss, D. & Vékony, O. (C++)

Final Results (Hard)

initial hack: -
current first place: -
current second place: -
current third place: -

Final Results (Soft)

initial hack: -
current first place: -
current second place: -
current third place: -

High-level programming languages II

See AI agents

Esport

See AGI agents

Artificial Intelligence agents (AI agents)

Artificial General Intelligence agents (AGI agents)

Our other Minecraft-based activities

References

[1] Johnson, M., Hofmann, K., Hutton, T.,Bignell, D. (2016). The Malmo Platform for Artificial Intelligence Experimentation, 25th International Joint Conference on Artificial Intelligence, https://www.ijcai.org/Proceedings/16/Papers/643.pdf

[2] Bátfai, N., Papp, D., Besenczi, R., Bogacsovics, G., & Veres, D. (2019). Benchmarking Cognitive Abilities of the Brain with the Event of Losing the Character in Computer Games. Studia Universitatis Babeș-Bolyai Informatica, 64(1), 15-25. doi:10.24193/subbi.2019.1.02

[3] Norbert Bátfai, Dávid Papp, Gergő Bogacsovics, Máté Szabó, Viktor Szilárd Simkó, Márió Bersenszki, Gergely Szabó, Lajos Kovács, Ferencz Kovács, Erik Szilveszter Varga (2019). Object file system software experiments about the notion of number in humans and machines. Cognition, Brain, Behavior. An interdisciplinary journal. Volume XXIII, Nr 4, 257-280, doi:10.24193/cbb.2019.23.15

[4] Bátfai, N., Csukonyi Cs., Papp D, Hermann Cs., Deákné O. E., Győri K. (2020) The DEAC-Hackers esport department's education and research concept in AI in Minecraft (accepted Hungarian manuscript)

Norbert Bátfai, PhD., University of Debrecen, IT Dept., [email protected]
nb4tf4i

Last modified: Fri, 8 May 2020 11:59:00 GMT

bbarna9 / redflowerhell Goto Github PK

redflowerhell's Introduction