video-performance-natives

[boyanl]

The video in Sophie2 is still slow, so maybe investigation of the underlying decoders is needed.

[boyanl]

Changes to Sophie2-Platform

• Changes to BinReader
  • Optimize readByte and readArray - instead of delegating to the underlying BinData (which we know is a RawBinData), we fetch all the bytes at construction and then just index the array. Similarly, in readArray, we use System.arraycopy (which can potentially be faster).
• Changes to BinWriter
  • Add addBytes method, which adds an array of bytes to the data.
• Add a class FastByteArrayOutputStream, which is a ByteArrayOutputStream implementation, which doesn't synchronize methods and doesn't copy the data when it's requested.
• Changes to RawBinData
  • Use FastByteArrayOutputStream instead of ByteArrayOutputStream when constructing it with a given size.
  • Change getBytes to not copy the data before returning it. It should be copied manually when we want to modify the returned data without modifying the RawBinData.
• Changed to size of buffers in BinData so that commands with video data are transported in 1 read (3 before)
• Fixed an error in SpellCheckDemoTest

Changes to Sophie2-Native

• Changes to the media decoder
  • Move the initalization of the structure used for conversion from decodeFrame to initVideo
  • Optimize the copy in saveFrame (this relies on the vector being continuous in memory, but this is standard)
  • Re-built the media decoder with FFMpeg 0.6
• Changes to java messages
  • readBinData accepts the resulting vector as a third argument instead of returning it (to avoid copying)
  • Optimize the copy in readBinData and writeBinData
  • Removed inconsistencies with mixed fread/cin.read or fwrite/cin.write (all are fread/fwrite)
• Changes to audio output
  • Attempt to optimize the copying by unrolling two loops
• Both media decoder and audio output are built using -O3 now (instead of -Os)

[boyanl]

Note: ffmpeg-0.6.tar.bz2 should be placed under sophie2-native/lib-src

[pap]

• Seem ok.
• I dislike the proposed representation exposure in RawBinData. So I suggest not using it unless it is really really necessary.

[boyanl]

• Attempting to fix video synchronization issue (NativeMediaHandler gets the framerate of the video and if we attempt to get frames within less than 1000/framerate millis, the same frame is returned)

[pap]

• Committed in [9271], [9272] and [9273].
• Accepted
• I decided not to use the proposed representation exposure in the RawBinData.getBytes method.
• some bad spacing here and there but otherwise good.

[meddle]

Closing all the tickets before M Y1