Describes the feature set and how to work with the Virtual App
Virtual Plugin for Unreal Engine 4/5
Remote Session Plugin
Video streaming from PC
Broadcast to the PC position and
rotation of the camera or object
The plugin allows to use of any objects in the scene, including all blueprints, cameras, etc., and moving them in real-time in the game scene using the Virtual App, which transfers the movement and rotation data of an Android device in space.
Buy at Unreal Engine Marketplace
How to start work with UE5 plugin
Description
Requirements
REQUIRED
- Unreal Engine 4.23, 4.24, 4.25
- Windows 10, 64-bit
- GeForce GTX 1060
- Intel i5 7th Generation CPU
- 8 GB RAM
- ARCore-capable Android device for Virtual App
- Wi-Fi physical layer speed according to IEEE 802.11n > 200 Mbps
RECOMMENDED
- GeForce GTX 1070 or above
- Intel i7 7th Generation CPU or above
- 16 GB RAM or above
- Wi-Fi physical layer speed according to IEEE 802.11n > 300 Mbps
First start
1. Run your project, and restart it if necessary. When the project has successfully started go to Edit-> Plugins-> Other and make sure the plugin is active.
If you added a plugin from the marketplace, you should go to “Content Browser” and select “Show Engine Content”.
For new users! Open “Camera Content” in “Content Browser” and drag “MyActor” to your scene.
For existing users! If you don’t see the new interface – open your “Actor blueprint” and find in the “Details” section “BPClasses”. Select “WBP_MainUserInterface”.
2. Open “Project settings” and find the “Input” section, and select “Always Show Touch Interface”.
Now you will have access to the interface during the launch of the scene with the settings of the joystick and video recording button.
In “MyActor” you can find the “Multiplication by number” section in which you can control the scale of the movement of the camera/object by increasing or decreasing the multiplier, the value of “1000” is 1: 1.
In the “Multiplication by number” section you can control your coordinates “Movement” and “Rotation”. Also, you can turn on and turn off all coordinates if you need.
In the “Body” section you can find “Auto Focus”. Also, you can turn it on and turn it off.
In the stabilization section, you can change the stabilization strength. For sensitive camera operation, select 0.5, and for very smooth operation, select 1.
In the “ARPhone/Bode” section you can control “Camera Follow” – mark it if you want to work with a virtual camera and unmark if you want to work with a virtual joystick, mark and unmark “Debug Message” and choose a camera to display, it can be “Cinematic Camera” (you should add it to the scene before choosing).
Only for Joystick mode! If you want to use Joystick mode and move an object in your scene, you just need to add any “Mesh” to the blueprint and unmark the camera following the “Actor” settings. Add a new “Component” in your Blueprint.
Add a new “Blueprint” to the scene. Now it will be working in the editor and compiled project on Windows and Android platforms.
3. Now you can click the “Play New Editor Window” button in your scene. After that launch Virtual App and click Auto IP in the app and run the Virtual Camera Connect button.
Solutions for some popular problems while using Plugin
1. If you are sure, that the network, PC, and mobiles are working well but you still have problems – this may help you:
Windows panel -> Settings -> Network&Internet -> Wi-Fi -> Windows Firewall and turn the firewall off, sometimes it can block data transfer on port 7777
You can also choose any other free port for data transfer, in this case, you will need to change them both in the application and the plugin settings in the “Network” section.
2. If video streaming does not cover all screens on the phone or instead It cuts some part of the viewport – change the play mode to “New Editor Window” on the top toolbar or try to adjust the viewport size.
3. If you have a connection issue use not loaded access point to fix the problem, the problem can be if you work in a place with a lot of devices on one router.
4. If you want to use VR mode – enable “Google VR plugin” and disable “Steam VR” because it can block video streaming.
5. Turn off “RTX” when you use “VR mode” If you will not do it you will get problems with the screen rendering and your phone will have one black window on one of the VR sides.
6. If you want to build your project you need to turn off UI (MyActor->Details panel->User Interface->”Enable GUI”) in “MyActor”, otherwise you will get an error launching your project’s Exe.
7. If you have an error like this when you run the project “CheckForFirewall.exe”: Go to MyActor on the scene->Details->ARPhone-> Network-> and untick “Turn off windows defender”
8. UI during render does not affect the final result of render.
9. Video panel in the sequencer becomes hidden because of incorrect tab switching. You can fix this issue in two ways:
-Close the Take Recorder panel and open it again.
-In the viewport in the left upper corner choose the tab ‘Perspective’. Choose ‘Viewport type’ – ‘Default’, then again ‘Cinematic’.
10. If the application is connected, the interface buttons are active, but the tracking does not occur, then check and set the permissions to use the camera in your mobile phone for the Virtual App application.
Virtual Plugin UI
This section outlines the Virtual Plugin UI and its settings.
1 – Visibility
Tapping the Hide icon in the upper-left corner will hide/show the Virtual Camera UI.
2 – Focus Mode
The two buttons in the left corner of the UI ( A, M ) are used to set the Focus Mode for the Virtual Camera.
Auto (A) – The default setting. The focus distance will continually update to keep whatever is in the middle in focus.
Manual (M) – The setting which will set the focus distance you can change by yourself. You can set a debug plane for better work with constant values each you can choose on the screen for changing focus distance.
3. Default Joysticks
You can click on a button and add joysticks for better camera control. The left joystick is responsible for moving forward and backward, and the right one is for moving up and down. This is required for working with large locations. In the main menu, you can change the movement speed multiplier for each joystick separately.
4. Recording Button
Clicking the Record button initiates a new recording while clicking again stops the recording.
5. Focus Distance
The Focus Distance is displayed in the top-right region of the UI.
6. Settings
Tapping on the Gear icon in the upper-right corner will bring up the Settings menu.
The General Settings tab contains the ability to configure camera stabilization, multiplication of the camera movement, and multiplication movement of the right and left joystick separately.
Axis locking will allow you to lock any quantity of axes. It can be handy for a linear dolly track effect or other cinematic tricks.
FilmBack settings will allow you to choose from a list of predetermined Film Formats and change Smooth Lens settings.
Pressing the Stop Tracking button will temporarily disable the input source so the view on the phone pauses, enabling the user to move the phone somewhere else in the real world. Pressing Continue Tracking then re-enables the input source but keeps the view offset.
You can add several cinematic cameras to the scene, pre-install them in the desired positions, and adjust all the settings for yourself. After that, just add them to the array so you can change them using the UI in the multi-camera section.
In the multi-camera section, you can select a pre-installed cinematic camera. After selecting a camera, you only need to click on the Unlock All Axes button. All preset settings will be displayed in the UI.