2019 Q4 Hyperledger Caliper

Created by Attila Klenik, last modified by Nathan George on Mar 31, 2020

Project Health

Since the first published release, the maintainers are working on improving the quality of the core code-base. Besides the obvious reasons for this, we also expect that a cleaner code-base will lower the entry barrier for new contributors.

Community relations mainly happen on Rocket.Chat, and the questions are answered in detail, and on time. Furthermore, there is an increasing contributor interest related to the supported DLTs (both improving recent adapters and implementing new ones, like for Corda).

Questions/Issues for the TSC

There are no issues at this time.

Releases

v0.2.0 was released on 25th October (on npm and DockerHub), see the GitHub release page . 

v0.3.0 is coming soon.

Overall Activity in the Past Quarter

  • Project stats (since the last report) Issues closed: 27 PRs merged: 73
  • Development-related
  • Exposed Prometheus metrics about client-side observations
  • Added highly flexible logging subsystem
  • Added platform support for Ethereum, Hyperledger Besu and FISCO-BCOS (all of them community contributions)
  • Released v0.2.0
  • Consolidated CI tests
  • Improved the result reporting, including embedded charts
  • Deprecated the Composer support
  • Added Yeoman generators for Caliper-related benchmark artifacts (plugin skeletons, configuration files)

Current Plans

Current development efforts are focusing on the following, core code-base related tasks (for the v0.3.0 release):

  • Reimplementing the distributed workload generation (which was removed in a previous release) using MQTT
  • Cleaning up the communication and dataflow in the worker and manager modules
  • Resulting in a highly modular architecture, which is easily extensible
  • Increasing workload generation performance by pushing aggregation tasks from the workers to the manager
  • Preparing a CI/CD for a rolling unstable release upon every merged PR (so the stable releases will have robust feature sets) 

Subsequent releases will target the improvement of platform supports, starting with the existing adapters.

Maintainer Diversity

The list of maintainers remained unchanged since the last report.

Contributor Diversity

There are currently 30 contributors to the repository, 17 of them with more than one commit. To the best of our knowledge, contributors are from various companies/organizations, such as Huawei, IBM, Intel, Soramitsu, Budapest University of Technology and Economics, Monax and the University of Oregon. The maintainers are also keeping in touch with other companies who are mainly interested in expanding the platform support of Caliper (e.g., with Corda).

Additional Information

N.A.

Reviewed by