Ir al contenido principal

How to integrate TensorflowJs and Unity by Creating a simple guessing game

This is a Tensorflow.js tutorial for integrating a javascript library with Unity, above is the vid and below you will find some of the steps followed.
  1. 1.

    Pre-reqs

  2. 2.

    Create the game using the Unity editor

  3. 3.

    Integrate unity with a javascript library like tensorflow.js - Calling a javascript library from unity

    • Create a class in unity with the methods that you already have in javascript
      • > Real "GetPrediction" method for using in webgl
          
        [DllImport("__Internal")]
        public static extern int GetPrediction(int valueToPredict);
          
        
      • > Debug "GetPrediction" method for using inside the editor
          
        #if UNITY_EDITOR
            public static int GetPrediction(int valueToPredict) {
                Debug.Log("Called GetPrediction");
        
                return 1;
            }
        #else
            //Real Method here
        #endif
          
        
    • Create a jslib file inside Assets/Plugins/WebGL with the "GetPrediction" method to be called
        
      mergeInto(LibraryManager.library, {
        //...
        GetPrediction: function (valueToPredict) {
          //Your logic here
          return window.PublicInterface.getPrediction(valueToPredict);
        }
      });
        
      
  4. 4.

    Integrate unity with a javascript library like tensorflow.js - Calling a unity C# method from javascript

    • Create a jslib file inside Assets/Plugins/WebGL with the "SendMessage" call referencing the name for the game object inside the scene and the method to be called
        
      mergeInto(LibraryManager.library, {
        //...
      
        //SendMessage('Game object name on scene', 'Method inside one of the components');
        SendMessage('PublicInterface', 'TrainingDone');
      
        //...
      });
        
      
    • Create a class in unity with the methods that you already have in javascript
      • > "TrainingDone" C# method for calling from javascript
          
        public class UnityInterfaceController : MonoBehaviour {
            public void TrainingDone() {
                //More code
            }
        }
          
        
    • Have a game object on the scene with the UnityInterfaceController monobehavior component attached to it
  5. 5.

    Create a node.js application to handle the integration with tensorflow.js

    • Change to the directory where the npm project is
        
      cd ./Assets/WebGLTemplates/TensorflowJsProjects/1.SimpleSequence
        
      
    • Install all the dependencies
        
      npm install
        
      
    • Start the compilation process
        
      npm run dev
        
      
    • Modify any .ts file and find the generated .js file inside ./Builds/WebGL/js/
  6. 6.

Comentarios

Entradas populares de este blog

Create a custom AEM workflow process step with a dialog

In this tutorial I talk about how to create a custom workflow step process with an additional dialog for configuring it, above is the vid and below you will find some useful notes. 1. Pre-reqs Have access to an Adobe Experience Manager instance. Have Maven installed, understand how it works and also understand how to use Adobe's archetype, you can watch my video about maven here: Creating an AEM application using Maven and Adobe's archetype 2. What is an AEM Workflow and workflow model Workflows allow you to automate different tasks inside AEM by defining a s

How to create an AEM component using Reactjs

In this tutorial, I will show how to use use Adobe's archetype to create an AEM application with React.js support and also how to add a new React.js component so that it can be added into a page, above is the vid and below you will find some useful notes. In the second part we will see how to configure the Sling Model for the AEM React component. 1. Pre-reqs Have access to an Adobe Experience Manager instance. You will need aem 6.4 Service Pack 2 or newer. Have Maven installed, understand how it works and also understand how to use Adobe's archetype, you can watch my video about maven here: Creating an AEM application using Maven and Adobe's archetype 2.

Creating Docker containers for Adobe Experience Manager

This is a Docker tutorial for creating a docker image for the Galen framework, above is the vid and below you will find some of the steps followed. Adobe experience manager is a content management system which in a nutshell is an application that allows us to create web sites to be consumed by end users. You might be familiar with other such applications like wordpress or drupal which serves the same purpose A typical deployment would be comprised of two AEM instances, the author instance used for creating and modifying content, the publish instance which serves the content and finally we have a dispatcher which is a static web server used for caching, load balancing and some security purposes. We can configure an AEM instance to work as an author or publish instance by either changing the file name