Ir al contenido principal

How to integrate TensorflowJs and Unity by Creating a simple guessing game

This is a Tensorflow.js tutorial for integrating a javascript library with Unity, above is the vid and below you will find some of the steps followed.
  1. 1.

    Pre-reqs

  2. 2.

    Create the game using the Unity editor

  3. 3.

    Integrate unity with a javascript library like tensorflow.js - Calling a javascript library from unity

    • Create a class in unity with the methods that you already have in javascript
      • > Real "GetPrediction" method for using in webgl
          
        [DllImport("__Internal")]
        public static extern int GetPrediction(int valueToPredict);
          
        
      • > Debug "GetPrediction" method for using inside the editor
          
        #if UNITY_EDITOR
            public static int GetPrediction(int valueToPredict) {
                Debug.Log("Called GetPrediction");
        
                return 1;
            }
        #else
            //Real Method here
        #endif
          
        
    • Create a jslib file inside Assets/Plugins/WebGL with the "GetPrediction" method to be called
        
      mergeInto(LibraryManager.library, {
        //...
        GetPrediction: function (valueToPredict) {
          //Your logic here
          return window.PublicInterface.getPrediction(valueToPredict);
        }
      });
        
      
  4. 4.

    Integrate unity with a javascript library like tensorflow.js - Calling a unity C# method from javascript

    • Create a jslib file inside Assets/Plugins/WebGL with the "SendMessage" call referencing the name for the game object inside the scene and the method to be called
        
      mergeInto(LibraryManager.library, {
        //...
      
        //SendMessage('Game object name on scene', 'Method inside one of the components');
        SendMessage('PublicInterface', 'TrainingDone');
      
        //...
      });
        
      
    • Create a class in unity with the methods that you already have in javascript
      • > "TrainingDone" C# method for calling from javascript
          
        public class UnityInterfaceController : MonoBehaviour {
            public void TrainingDone() {
                //More code
            }
        }
          
        
    • Have a game object on the scene with the UnityInterfaceController monobehavior component attached to it
  5. 5.

    Create a node.js application to handle the integration with tensorflow.js

    • Change to the directory where the npm project is
        
      cd ./Assets/WebGLTemplates/TensorflowJsProjects/1.SimpleSequence
        
      
    • Install all the dependencies
        
      npm install
        
      
    • Start the compilation process
        
      npm run dev
        
      
    • Modify any .ts file and find the generated .js file inside ./Builds/WebGL/js/
  6. 6.

Comentarios

Entradas populares de este blog

Create a custom AEM workflow process step with a dialog

In this tutorial I talk about how to create a custom workflow step process with an additional dialog for configuring it, above is the vid and below you will find some useful notes. 1.Pre-reqs Have access to an Adobe Experience Manager instance. Have Maven installed, understand how it works and also understand how to use Adobe's archetype, you can watch my video about maven here: Creating an AEM application using Maven and Adobe's archetype 2.What is an AEM Workflow and workflow model Workflows allow you to automate different tasks inside AEM by defining a sequence of steps to be executed and the actions to be performed at each step. A workflow model represents the definition of a workflow using nodes for the steps or actions to be executed and transitions to define how the steps are organized and what is going to be th…

Creating Docker containers for Adobe Experience Manager

This is a Docker tutorial for creating a docker image for the Galen framework, above is the vid and below you will find some of the steps followed. Adobe experience manager is a content management system which in a nutshell is an application that allows us to create web sites to be consumed by end users. You might be familiar with other such applications like wordpress or drupal which serves the same purpose A typical deployment would be comprised of two AEM instances, the author instance used for creating and modifying content, the publish instance which serves the content and finally we have a dispatcher which is a static web server used for caching, load balancing and some security purposes. We can configure an AEM instance to work as an author or publish instance by either changing the file name for the jar file java -jar cq-author-450…

Creating a Mongo replicaset using docker: Mongo replicaset + Nodejs + Docker Compose

This is a Docker tutorial for creating a Mongo replica set using docker compose and also a couple more containers to experiment with the replica set, above is the vid and below you will find some of the steps followed.
StepsPre-reqsHave node.js installedAnd docker installed (make sure you have docker-compose as well)Create a container for defining configurations for a mongo instanceCreate a container for setting up the replica setCreate a simple node app using expressjs and mongoose (A modified version from the previous video)Create a docker-compose file with the mongo and setup containers and two additional containers for experimenting with the replica setBuild, Run and experiment with your new containers Create a dockerfile for the first mongo container (not really needed but you could configure more stuff if needed)Include container with mongo preinstalled: FROM mongoCreate default/working directory: WORKDIR /usr/src/configsCopy mongo's configurations file into the container
C…