-
Notifications
You must be signed in to change notification settings - Fork 80
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge branch 'main' into 98-spec-props
- Loading branch information
Showing
30 changed files
with
1,275 additions
and
44 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,8 @@ | ||
| ::: jumanji.environments.logic.sliding_tile_puzzle.env.SlidingTilePuzzle | ||
| selection: | ||
| members: | ||
| - __init__ | ||
| - reset | ||
| - step | ||
| - observation_spec | ||
| - action_spec |
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,52 @@ | ||
| # Sliding Tile Puzzle Environment | ||
|
|
||
| <p align="center"> | ||
| <img src="../env_anim/sliding_tile_puzzle.gif" width="500"/> | ||
| </p> | ||
|
|
||
| This is a Jax JIT-able implementation of the classic [Sliding Tile Puzzle game](https://en.wikipedia.org/wiki/Sliding_puzzle). | ||
|
|
||
| The Sliding Tile Puzzle game is a classic puzzle that challenges a player to slide (typically flat) pieces along certain routes (usually on a board) to establish a certain end-configuration. The pieces to be moved may consist of simple shapes, or they may be imprinted with colors, patterns, sections of a larger picture (like a jigsaw puzzle), numbers, or letters. | ||
|
|
||
| The puzzle is often 3×3, 4×4 or 5×5 in size and made up of square tiles that are slid into a square base, larger than the tiles by one tile space, in a specific large configuration. Tiles are moved/arranged by sliding an adjacent tile into a position occupied by the missing tile, which creates a new space. The sliding puzzle is mechanical and requires the use of no other equipment or tools. | ||
|
|
||
| ## Observation | ||
|
|
||
| The observation in the Sliding Tile Puzzle game includes information about the puzzle, the position of the empty tile, and the action mask. | ||
|
|
||
| - `puzzle`: jax array (int32) of shape `(grid_size, grid_size)`, representing the current game state. Each element in the array corresponds to a puzzle tile. The tile represented by 0 is the empty tile. | ||
|
|
||
| - Here is an example of a random observation of the game board: | ||
|
|
||
| ``` | ||
| [[ 1 2 3 4] | ||
| [ 5 6 7 8] | ||
| [ 9 10 0 12] | ||
| [ 13 14 15 11]] | ||
| ``` | ||
| - In this array, the tile represented by 0 is the empty tile that can be moved. | ||
|
|
||
| - `empty_tile_position`: a tuple (int32) of shape `(2,)` representing the position of the empty tile in the grid. For example, (2, 2) would represent the third row and the third column in a zero-indexed grid. | ||
|
|
||
| - `action_mask`: jax array (bool) of shape `(4,)`, indicating which actions are valid in the current state of the environment. The actions include moving the empty tile up, right, down, or left. For example, an action mask `[True, False, True, False]` means that the valid actions are to move the empty tile upward or downward. | ||
|
|
||
| - `step_count`: jax array (int32) of shape `()`, current number of steps in the episode. | ||
|
|
||
| ## Action | ||
|
|
||
| The action space is a `DiscreteArray` of integer values in `[0, 1, 2, 3]`. Specifically, these four actions correspond to moving the empty tile: up (0), right (1), down (2), or left (3). | ||
|
|
||
| ## Reward | ||
|
|
||
| The reward could be either: | ||
|
|
||
| - **DenseRewardFn**: This reward function provides a dense reward based on the difference of correctly placed tiles between the current state and the next state. The reward is positive for each newly correctly placed tile and negative for each newly incorrectly placed tile. | ||
|
|
||
| - **SparseRewardFn**: This reward function provides a sparse reward, only rewarding when the puzzle is solved. | ||
| The reward is 1 if the puzzle is solved, and 0 otherwise. | ||
|
|
||
| The goal in all cases is to solve the puzzle in a way that maximizes the reward. | ||
|
|
||
| ## Registered Versions 📖 | ||
|
|
||
| - `SlidingTilePuzzle-v0`, the Sliding Tile Puzzle with a grid size of 5x5. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
16 changes: 16 additions & 0 deletions
16
jumanji/environments/logic/sliding_tile_puzzle/__init__.py
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,16 @@ | ||
| # Copyright 2022 InstaDeep Ltd. All rights reserved. | ||
| # | ||
| # Licensed under the Apache License, Version 2.0 (the "License"); | ||
| # you may not use this file except in compliance with the License. | ||
| # You may obtain a copy of the License at | ||
| # | ||
| # http://www.apache.org/licenses/LICENSE-2.0 | ||
| # | ||
| # Unless required by applicable law or agreed to in writing, software | ||
| # distributed under the License is distributed on an "AS IS" BASIS, | ||
| # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. | ||
| # See the License for the specific language governing permissions and | ||
| # limitations under the License. | ||
|
|
||
| from jumanji.environments.logic.sliding_tile_puzzle.env import SlidingTilePuzzle | ||
| from jumanji.environments.logic.sliding_tile_puzzle.types import Observation, State |
42 changes: 42 additions & 0 deletions
42
jumanji/environments/logic/sliding_tile_puzzle/conftest.py
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,42 @@ | ||
| # Copyright 2022 InstaDeep Ltd. All rights reserved. | ||
| # | ||
| # Licensed under the Apache License, Version 2.0 (the "License"); | ||
| # you may not use this file except in compliance with the License. | ||
| # You may obtain a copy of the License at | ||
| # | ||
| # http://www.apache.org/licenses/LICENSE-2.0 | ||
| # | ||
| # Unless required by applicable law or agreed to in writing, software | ||
| # distributed under the License is distributed on an "AS IS" BASIS, | ||
| # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. | ||
| # See the License for the specific language governing permissions and | ||
| # limitations under the License. | ||
|
|
||
| import jax | ||
| import jax.numpy as jnp | ||
| import pytest | ||
|
|
||
| from jumanji.environments.logic.sliding_tile_puzzle import SlidingTilePuzzle | ||
| from jumanji.environments.logic.sliding_tile_puzzle.generator import RandomWalkGenerator | ||
| from jumanji.environments.logic.sliding_tile_puzzle.types import State | ||
|
|
||
|
|
||
| @pytest.fixture | ||
| def sliding_tile_puzzle() -> SlidingTilePuzzle: | ||
| """Instantiates a default SlidingTilePuzzle environment.""" | ||
| generator = RandomWalkGenerator(grid_size=3) | ||
| return SlidingTilePuzzle(generator=generator) | ||
|
|
||
|
|
||
| @pytest.fixture | ||
| def state() -> State: | ||
| key = jax.random.PRNGKey(0) | ||
| empty_pos = jnp.array([0, 0]) | ||
| puzzle = jnp.array( | ||
| [ | ||
| [0, 1, 3], | ||
| [4, 2, 5], | ||
| [7, 8, 6], | ||
| ] | ||
| ) | ||
| return State(puzzle=puzzle, empty_tile_position=empty_pos, key=key, step_count=0) |
24 changes: 24 additions & 0 deletions
24
jumanji/environments/logic/sliding_tile_puzzle/constants.py
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,24 @@ | ||
| # Copyright 2022 InstaDeep Ltd. All rights reserved. | ||
| # | ||
| # Licensed under the Apache License, Version 2.0 (the "License"); | ||
| # you may not use this file except in compliance with the License. | ||
| # You may obtain a copy of the License at | ||
| # | ||
| # http://www.apache.org/licenses/LICENSE-2.0 | ||
| # | ||
| # Unless required by applicable law or agreed to in writing, software | ||
| # distributed under the License is distributed on an "AS IS" BASIS, | ||
| # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. | ||
| # See the License for the specific language governing permissions and | ||
| # limitations under the License. | ||
| import jax.numpy as jnp | ||
|
|
||
| EMPTY_TILE = 0 | ||
| INITIAL_STEP_COUNT = 0 | ||
|
|
||
| UP = [-1, 0] | ||
| RIGHT = [0, 1] | ||
| DOWN = [1, 0] | ||
| LEFT = [0, -1] | ||
|
|
||
| MOVES = jnp.array([UP, RIGHT, DOWN, LEFT]) |
Oops, something went wrong.