xavierpuigf / virtualhome_unity Goto Github PK

View Code? Open in Web Editor NEW

54.0 54.0 25.0 1.66 GB

Source Code for VirtualHome environment

License: MIT License

C# 67.94% ShaderLab 17.16% HLSL 12.54% Python 0.31% GLSL 2.05%

virtualhome_unity's People

Contributors

Stargazers

Watchers

virtualhome_unity's Issues

Are there still a discord chanel of virtualhome?

Hi, we are interesting in some research based on virtualhome. It seems that the old Discord chanel disappear. Are there still a discord chanel to get quick response?

It seems the Unity version document should be updated

@kswain98 Hi, I met the same question about Navmesh, and I find a closed issue has solved it. It seems you'd better update the document soon about the Unity version to avoid others meeting this problem.

What else, I want to ask that has this project using NSM. I found a branch named NSM_incoporation and there is some code of NSM in it.

The link in Documentation still 404

Unable to join player connection multicast group？

The following ERROR is reported when the Unity project is opened：
Unable to join player connection multicast group.

How to solve this problem?

may I scan my own apartment using iPhone lidar (or maybe matterport 3d) and turns it into virtualhome environment?

thanks for the wonderful job~

may I scan my own apartment using iPhone lidar (or maybe matterport 3d) and turns it into virtualhome environment?

How can I add new scenes to the simulator?

If I have the mesh of another scene and the objects in it, what do I need to do to make the simulator work well with the new scene.

I found the documentation about adding new objects, but add scenes is more difficult.

Does this project need the plug-in of Final IK？

There are many errors after opening the project

Like：
Assets\Story Generator\Animator\Scripts\BlendHandRelativePos.cs(1,7): error CS0246: The type or namespace name 'RootMotion' could not be found (are you missing a using directive or an assembly reference?)

Does this project need the plug-in of Final IK？

Failed to load NavMesh.asset because it was serialized with a newer version of Unity.

Hello
I opened the latest version of master in unity 2018.4.4 and whenever I open a test scene I encounter errors similar to this one:
Failed to load 'D:/Code/virtualhome_unity/Assets/Story Generator/TestScene/TestScene_6/NavMesh.asset' because it was serialized with a newer version of Unity. (Has a higher SerializedFile version)

One of the authors mentioned that the latest build was made using 2019.X.
Can you please specify the exact unity version that was used ?

Also, you should update the documentation and specify to open the project in unity 2019.X and not in 2018.4.

Thank you

Framerate and animation speed correlation

Hello
When calling render_script with higher framerates, the avatar movement speed is lower and vice-versa (lower framerates equals to higher movement speed).
Is this indented by design?

Thank you

How to change the texture of objects?

Hi, thanks for the great work of virtual-home-unity.

I intend to make some custom modifications to the texture of objects (such as furniture, walls, and floors). Specifically, I hope to add some stains (e.g, black dots) to them so that they may look dirty.

I notice that the texture is set with a png/jpg/tga image, for example

Can I directly modify these images and expect objects to have modified textures? Do I need, for example, recompile the unity source code to make my modification work?

If not, is there any way that I can do what I want?

(I am quite new to unity, so, please forgive me if this is a naive question) Thanks a lot for the help.

UnityCommunicationException called when using the camera_image function.

Hi there, I am trying to follow this doc and build my own virtual-home exe from the source (I am on Mac OS and Unity Hub).

Following the doc, I have successfully opened the virtualhome_unity-master respositary in Unity Hub, and added the third party assets. There is no error when I press the Play button in unity, and I can successfully use the demo functions such as comm.reset, comm.add_character, comm.render_script (to make the character move, and to record a video), ect.

However, when I try to take a picture of the environment by s, im = comm.camera_image(0), the following error showed:

---------------------------------------------------------------------------
timeout                                   Traceback (most recent call last)
~/anaconda3/lib/python3.7/site-packages/urllib3/connectionpool.py in _make_request(self, conn, method, url, timeout, chunked, **httplib_request_kw)
    383                     # otherwise it looks like a programming error was the cause.
--> 384                     six.raise_from(e, None)
    385         except (SocketTimeout, BaseSSLError, SocketError) as e:

~/anaconda3/lib/python3.7/site-packages/urllib3/packages/six.py in raise_from(value, from_value)

~/anaconda3/lib/python3.7/site-packages/urllib3/connectionpool.py in _make_request(self, conn, method, url, timeout, chunked, **httplib_request_kw)
    379                 try:
--> 380                     httplib_response = conn.getresponse()
    381                 except Exception as e:

~/anaconda3/lib/python3.7/http/client.py in getresponse(self)
   1335             try:
-> 1336                 response.begin()
   1337             except ConnectionError:

~/anaconda3/lib/python3.7/http/client.py in begin(self)
    305         while True:
--> 306             version, status, reason = self._read_status()
    307             if status != CONTINUE:

~/anaconda3/lib/python3.7/http/client.py in _read_status(self)
    266     def _read_status(self):
--> 267         line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
    268         if len(line) > _MAXLINE:

~/anaconda3/lib/python3.7/socket.py in readinto(self, b)
    588             try:
--> 589                 return self._sock.recv_into(b)
    590             except timeout:

timeout: timed out

During handling of the above exception, another exception occurred:

ReadTimeoutError                          Traceback (most recent call last)
~/anaconda3/lib/python3.7/site-packages/requests/adapters.py in send(self, request, stream, timeout, verify, cert, proxies)
    448                     retries=self.max_retries,
--> 449                     timeout=timeout
    450                 )

~/anaconda3/lib/python3.7/site-packages/urllib3/connectionpool.py in urlopen(self, method, url, body, headers, retries, redirect, assert_same_host, timeout, pool_timeout, release_conn, chunked, body_pos, **response_kw)
    637             retries = retries.increment(method, url, error=e, _pool=self,
--> 638                                         _stacktrace=sys.exc_info()[2])
    639             retries.sleep()

~/anaconda3/lib/python3.7/site-packages/urllib3/util/retry.py in increment(self, method, url, response, error, _pool, _stacktrace)
    367             if read is False or not self._is_method_retryable(method):
--> 368                 raise six.reraise(type(error), error, _stacktrace)
    369             elif read is not None:

~/anaconda3/lib/python3.7/site-packages/urllib3/packages/six.py in reraise(tp, value, tb)
    685             raise value.with_traceback(tb)
--> 686         raise value
    687 

~/anaconda3/lib/python3.7/site-packages/urllib3/connectionpool.py in urlopen(self, method, url, body, headers, retries, redirect, assert_same_host, timeout, pool_timeout, release_conn, chunked, body_pos, **response_kw)
    599                                                   body=body, headers=headers,
--> 600                                                   chunked=chunked)
    601 

~/anaconda3/lib/python3.7/site-packages/urllib3/connectionpool.py in _make_request(self, conn, method, url, timeout, chunked, **httplib_request_kw)
    385         except (SocketTimeout, BaseSSLError, SocketError) as e:
--> 386             self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
    387             raise

~/anaconda3/lib/python3.7/site-packages/urllib3/connectionpool.py in _raise_timeout(self, err, url, timeout_value)
    305         if isinstance(err, SocketTimeout):
--> 306             raise ReadTimeoutError(self, url, "Read timed out. (read timeout=%s)" % timeout_value)
    307 

ReadTimeoutError: HTTPConnectionPool(host='127.0.0.1', port=33210): Read timed out. (read timeout=30)

During handling of the above exception, another exception occurred:

ReadTimeout                               Traceback (most recent call last)
~/Desktop/virtualhome-master/virtualhome/simulation/unity_simulator/comm_unity.py in post_command(self, request_dict, repeat)
     91             else:
---> 92                 resp = requests.post(self._address, json=request_dict, timeout=self.timeout_wait)
     93             if resp.status_code != requests.codes.ok:

~/anaconda3/lib/python3.7/site-packages/requests/api.py in post(url, data, json, **kwargs)
    115 
--> 116     return request('post', url, data=data, json=json, **kwargs)
    117 

~/anaconda3/lib/python3.7/site-packages/requests/api.py in request(method, url, **kwargs)
     59     with sessions.Session() as session:
---> 60         return session.request(method=method, url=url, **kwargs)
     61 

~/anaconda3/lib/python3.7/site-packages/requests/sessions.py in request(self, method, url, params, data, headers, cookies, files, auth, timeout, allow_redirects, proxies, hooks, stream, verify, cert, json)
    532         send_kwargs.update(settings)
--> 533         resp = self.send(prep, **send_kwargs)
    534 

~/anaconda3/lib/python3.7/site-packages/requests/sessions.py in send(self, request, **kwargs)
    645         # Send the request
--> 646         r = adapter.send(request, **kwargs)
    647 

~/anaconda3/lib/python3.7/site-packages/requests/adapters.py in send(self, request, stream, timeout, verify, cert, proxies)
    528             elif isinstance(e, ReadTimeoutError):
--> 529                 raise ReadTimeout(e, request=request)
    530             else:

ReadTimeout: HTTPConnectionPool(host='127.0.0.1', port=33210): Read timed out. (read timeout=30)

During handling of the above exception, another exception occurred:

UnityCommunicationException               Traceback (most recent call last)
<ipython-input-11-ad20083008a6> in <module>
----> 1 s, im = comm.camera_image(cam_count-1)

~/Desktop/virtualhome-master/virtualhome/simulation/unity_simulator/comm_unity.py in camera_image(self, camera_indexes, mode, image_width, image_height)
    347         return response['success'], _decode_image_list(response['message_list'])
    348 
--> 349     def instance_colors(self):
    350         """
    351         Return a mapping from rgb colors, shown on `seg_inst` to object `id`, specified in the environment graph.

~/Desktop/virtualhome-master/virtualhome/simulation/unity_simulator/comm_unity.py in post_command(self, request_dict, repeat)
     96             return resp.json()
     97         except requests.exceptions.RequestException as e:
---> 98             raise UnityCommunicationException(str(e))
     99 
    100     def check_connection(self):

UnityCommunicationException: HTTPConnectionPool(host='127.0.0.1', port=33210): Read timed out. (read timeout=30)

And I noticed that after this error showed, if I call, for example, comm.reset or comm.add_character, it would also fail (with the same error).

Note that I use the default port 8080, so it is wierd that the bug said HTTPConnectionPool(host='127.0.0.1', port=33210): Read timed out.

Any idea how this error comes and how can I solve it? Many thanks.

Cannot run the unity environment

Hello Dear Xavier,

Thanks for your great work! When I used Unity 2018.4.4.f1 (as the project suggested, installed from Unity Hub) to open the project (without any modification, tested both on ubuntu16 and mac os big sur), I encountered the following errors.

Are these due to the reason that I miss installing some supporting packages?

Thanks in advance.
Best,

How can I get room assets?

I downloaded the git repo and loaded on the Unity, but cannot find room assets.
There are prefabs in the floor plan folders, but they include only object layouts but not room models.
Does anyone know where I can get the room assets used in virtual home?

Simulator Runs HttpServer that listens on all interfaces

When the simulator is launched, the HttpServer listens on all interfaces at the specified -http-port according to communication.cs

Can you add an option to specify a specific address to open the port on? i.e. use the WebSocketSharp.Server.HttpServer(url) as an option vs WebSocketSharp.Server.HttpServer(port).

This will resolve controlling the exposed ports when running the simulator.

Can I make any scene, character, or action I want?

Can I make any scenes, characters, or actions I want in this repo?

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.