“Unified motion planner for fishes with various swimming styles”

  • ©Daiki Satoi, Mikihiro Hagiwara, Akira Uemoto, Hisanao Nakadai, and Junichi Hoshino




    Unified motion planner for fishes with various swimming styles

Session/Category Title: MOTION CONTROL




    We propose a unified motion planner that reproduces variations in swimming styles based on the differences in the fish skeletal structures or the variations in the swimming styles based on changes in environmental conditions. The key idea in our method, based on biology, is the following. We considered the common decision-making mechanism in fish that allows them to instantly decide “where and how to swim.” The unified motion planner comprises two stages. In the first stage, where to swim to is decided. Using a probability distribution generated by integrating the perceptual information, the short-term target position and target speed are decided. In the second stage, how to swim is decided. A style of swimming that matches the information for transitioning from the current speed to the target speed is selected. Using the proposed method, we demonstrate 12 types of CG models with completely different sizes and skeletal structures, such as manta ray, tuna, and boxfish, as well as a scene where a school of a few thousand fish swim realistically. Our method is easy to integrate into existing graphics pipelines. In addition, in our method, the movement characteristics can easily be changed by adjusting the parameters. The method also has a feature where the expression of an entire school of fish, such as tornado or circling, can be designated top-down.


    1. Archer, S., and Johnston, I. 1989. Kinematics of labriform and subcarangiform swimming in the antarctic fish. Journal of Experimental Biology 210, 143, 195–210.Google Scholar
    2. Bentley, J. L. 1975. Multidimensional binary search trees used for associative searching. Communications of the ACM 18, 9, 509–517. Google ScholarDigital Library
    3. Bone, Q., Kiceniuk, J., and Jones, D. 1978. On the role of the different fibre types in fish myotomes at intermediate swimming speeds. Fishery Bulletin 76, 691–699.Google Scholar
    4. Box, G. E. P., and Muller, M. E. 1958. A note on the generation of random normal deviates. The Annals of Mathematical Statistics 29, 2, 610–611.Google ScholarCross Ref
    5. Domenici, P., and Blake, R. W. 1997. The kinematics and performance of fish fast-start swimming. The Journal of Experimental Biology 200, 1165–1178.Google ScholarCross Ref
    6. Friedlander, A. M., and Parrish, J. D. 1997. Temporal dynamics of fish communities on an exposed shoreline in Hawaii. Environmental Biology of Fishes 53, 1, 1–18.Google ScholarCross Ref
    7. Funge, J., Tu, X., and Terzopoulos, D. 1999. Cognitive modeling: knowledge, reasoning and planning for intelligent characters. In Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH ’99), 29–38. Google ScholarDigital Library
    8. Gaesser, G. A., and Brooks, G. A. 1984. Metabolic bases of excess post-exercise oxygen consumption: a review. Medicine and Science in Sports and Exercise 16, 1, 29–43.Google ScholarCross Ref
    9. Geijtenbeek, T., and Pronost, N. 2012. Interactive character animation using simulated physics: a state-of-the-art review. Computer Graphics Forum 31, 8, 2492–2515. Google ScholarDigital Library
    10. Grzeszczuk, R., and Terzopoulos, D. 1995. Automated learning of muscle-actuated locomotion through control abstraction. In Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH ’95), 63–70. Google ScholarDigital Library
    11. Hove, J. R., O’Bryan, L. M., Gordon, M. S., Webb, P. W., and Weihs, D. 2001. Boxfishes (Teleostei: Ostraciidae) as a model system for fishes swimming with many fins: kinematics. Journal of Experimental Biology 204, 1459–1471.Google ScholarCross Ref
    12. Hudson, R. C. 1973. On the function of the white muscles in teleosts at intermediate swimming speeds. Journal of Experimental Biology 58, 509–522.Google ScholarCross Ref
    13. Ju, E., Won, J., Lee, J., Choi, B., Noh, J., and Choi, M. G. 2013. Data-driven control of flapping flight. ACM Transactions on Graphics 32, 212. Google ScholarDigital Library
    14. Kallmann, M., and Kapadia, M. 2014. Navigation meshes and real-time dynamic planning for virtual worlds. In ACM SIGGRAPH 2014 Courses. Google ScholarDigital Library
    15. Krupczynski, P., and Schuster, S. 2008. Report fruit-catching fish tune their fast starts to compensate for drift. Current Biology 18, 24, 1961–1965.Google ScholarCross Ref
    16. Lighthill, M. 1971. Large-amplitude elongated-body theory of fish locomotion. Proceedings of the Royal Society B: Biological Sciences 179, 1055, 125–138.Google Scholar
    17. Lindsey, C. 1978. Form, function, and locomotory habits in fish. In Fish Physiology, W. Hoar and D. Randall, Eds. Academic Press, New York, NY, United States, ch. 1, 1–100.Google Scholar
    18. Masehian, E., and Sedighizadeh, D. 2007. Classic and heuristic aproaches in robot motion planning — a chronological review. In World Academy of Science, Engineering and Technology, vol. 1, 101–106.Google Scholar
    19. Masuda, R. 2008. Seasonal and interannual variation of subtidal fish assemblages in Wakasa Bay with reference to the warming trend in the Sea of Japan. Environmental Biology of Fishes 82, 4, 387–399.Google ScholarCross Ref
    20. Nelson, J. S. 2006. Fishes of the world, 4th ed. Wiley, Hoboken, NJ, United States.Google Scholar
    21. Peng, X. B., Berseth, G., and van de Panne, M. 2015. Dynamic terrain traversal skills using reinforcement learning. ACM Transactions on Graphics 34, 4. Google ScholarDigital Library
    22. Rayner, M., and Keenan, M. 1967. Role of red and white muscles in the swimming of the skipjack tuna. Nature 214, 392–393.Google ScholarCross Ref
    23. Reynolds, C. W. 1987. Flocks, herds and schools: a distributed behavioral model. Computer Graphics 21, 4, 25–34. Google ScholarDigital Library
    24. Rhodin, H., Tompkin, J., Kim, K. I., Aguiar, E. D., Pfister, H., Seidel, H.-p., and Theobalt, C. 2015. Generalizing wave gestures from sparse examples for real-time character control. ACM Transactions on Graphics 34, 6. Google ScholarDigital Library
    25. Schuster, S. 2012. Fast-starts in hunting fish: decision-making in small networks of identified neurons. Current Opinion in Neurobiology 22, 2, 279–284.Google ScholarCross Ref
    26. Si, W., Lee, S.-h., and Terzopoulos, D. 2014. Realistic biomechanical simulation and control of human swimming. ACM Transactions on Graphics 34, 1. Google ScholarDigital Library
    27. Sims, K. 1994. Evolving virtual creatures. In Proceedings of the 21st Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH ’94). 15–22. Google ScholarDigital Library
    28. Stanton, A., and Unkrich, L. 2003. Finding Nemo {motion picture}. United States: Walt Disney Pictures.Google Scholar
    29. Tan, J., Gu, Y., Turk, G., and Liu, C. K. 2011. Articulated swimming creatures. ACM Transactions on Graphics 30, 4. Google ScholarDigital Library
    30. Tan, J., Turk, G., and Liu, C. K. 2012. Soft body locomotion. ACM Transactions on Graphics 31, 4. Google ScholarDigital Library
    31. Terzopoulos, D., Tu, X., and Grzeszczuk, R. 1994. Artificial fishes: autonomous locomotion, perception, behavior, and learning in a simulated physical world. Artificial Life 1, 4, 327–351. Google ScholarDigital Library
    32. Tsukamoto, K. 1984. Contribution of the red and white muscles to the power output required for swimming by the Yellowtail. Bulletin of the Japanese Society of Scientific Fisheries 50, 12, 2031–2042.Google ScholarCross Ref
    33. Tsukamoto, K. 1984. The role of the red and white muscles during swimming of the Yellowtail. Bulletin of the Japanese Society of Scientific Fisheries 50, 12, 2025–2030.Google ScholarCross Ref
    34. Tu, X., and Terzopoulos, D. 1994. Artificial fishes: physics, locomotion, perception, behavior. In Proceedings of the 21st Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH ’94), ACM, New York, NY, United States, 43–50. Google ScholarDigital Library
    35. Walker, J. A. 2000. Does a rigid body limit maneuverability? Journal of Experimental Biology 203, 22, 3391–3396.Google ScholarCross Ref
    36. Wang, H., Ho, E. S. L., and Komura, T. 2015. An energy-driven motion planning method for two distant postures. IEEE Transactions on Visualization and Computer Graphics 21, 1, 18–30.Google ScholarCross Ref
    37. Willy, A., and Low, K. 2005. Development and initial experiment of modular undulating fin for untethered biorobotic AUVs. In IEEE International Conference on Robotics and Biomimetics (ROBIO), 45–50.Google Scholar
    38. Yamaguchi, Y. 2008. Aquanaut’s Holiday: Hidden Memories {PlayStation 3}. Japan: Sony Computer Entertainment.Google Scholar

ACM Digital Library Publication:

Overview Page: