Hedera Hashgraph

Release Note

After scheduled transactions was made available in previewnet, we listened to user feedback and further iterated on the design to make it easier to use. This release adds support for this revised scheduled transactions design planned to be released in HAPI v0.13. There was no impact to our REST API format, only the importer needed to be updated to parse and ingest the new proto format. Our monitor API and acceptance tests will be adjusted in the next release once the SDKs add support for the new design.
This release also adds support for the newly announced account balance file format that was released in HAPI v0.12. The new protobuf based format will eventually replace the CSV format in July 2021. Until then, both formats will exist simultaneously in the bucket so users can transition at their leisure. Besides being more efficient to parse, the new files are also compressed using Gzip for reduced storage and download costs. We also took the time to improve the balance file parsing performance regardless of format. Average parse times should decrease by about 27%.
For our REST API, we now expose an entity_id field on our transactions related APIs. This field represents that main entity associated with that transaction type. For example, if it was a HCS transaction it would be the topic ID created, updated, or deleted.
GET /api/v1/transactions/0.0.1009-1234567890-999999998
{
  "transactions": [{
    "consensus_timestamp": "1234567890.999999999",
    "entity_id": "0.0.108763",
    "valid_start_timestamp": "1234567890.999999998",
    "charged_tx_fee": 0,
    "memo_base64": null,
    "result": "SUCCESS",
    "scheduled": false,
    "transaction_hash": "aGFzaA==",
    "name": "CRYPTOUPDATEACCOUNT",
    "node": "0.0.3",
    "transaction_id": "0.0.1009-1234567890-999999998",
    "valid_duration_seconds": "11",
    "max_fee": "33",
    "transfers": []
  }]
}

We continue to make progress towards our goal of switching to TimescaleDB. We fixed the user and database initialization issues and tested a migration from PostgreSQL. We switched out the TimescaleDB Helm chart to a more stable one and explored our hosting options for production. Finally we switched to SCRAM-SHA-256 to improve the security of our database user authentication.
Breaking changes:
There were a number of breaking changes this release to be aware of. If you're using our Helm chart, we have switched the importer from a StatefulSet to a Deployment since it no longer has the need for a persistent volume. We also switched the Traefik dependency from a Deployment to a DaemonSet. Both of these will require manual intervention to delete the old workload before upgrading. Support for Helm 2 was dropped since it is no longer supported by the community after November 13, 2020. If you're directly reading from our database, a rename of the t_entities table and its columns may impact you as well.
Enhancements

Bump versions for v0.31.0 #1843
Bump versions for v0.31.0-rc1 #1818
Update entity table references in entity migration tool #1815
Fixes to the timescale migration script #1798
Change importer to Deployment & bump dependencies #1797
Use scram-sha-256 password authentication for TimescaleDB #1795
Expose entity_id in transactions REST API #1791
Move Sonar to separate job & fix chart test #1768
Update importer for revised scheduled transaction design #1766
Add postInit to timescaledb chart #1764
Helm v3 #1752
Use secure authentication for TimescaleDB #1739
Update REST API for revised scheduled transaction design #1738
Update importer for revised scheduled transaction design #1737
Proto based balance file parser #1713
Parse proto-based balance file #1679
Expose entity_id on /api/v1/transactions endpoint #1639
Upgrade to Helm 3 #1502
Properly initialize timescaledb before other resources access it #1439
TimescaleDB: Test data migration from pre-prod environment to k8s cluster #1423
TimescaleDB: Explore Hosting Options #1422

Bug Fixes

Fix REST API image #1817
Port multi-scenario running longer fix #1807
Fix test image build #1794
Fix master deploy failing #1793
Fix REST artifact missing v prefix #1787
Fix jar name & bump to v0.31.0-alpha3 #1786
Fix release artifact & bump to v0.31.0-alpha2 #1784
Migrate and update t_entities to entity table #1779
Monitor may run a scenario for multiple of the configured duration / number of transactions #1777
Improve balance file performance #1767
Clean up t_entities columns with empty values #1740
Balance file parsing performance #1736
Provide migration tool to fix incorrect keys in t_entities #1721
Incorrect entity keys #509

Dependency Upgrades

Bump docker-maven-plugin from 0.34.1 to 0.35.0 #1810
Bump download-maven-plugin from 1.6.1 to 1.6.2 #1805
Bump software.amazon.awssdk:bom from 2.16.31 to 2.16.34 #1804
Bump protobuf-java from 3.15.6 to 3.15.7 #1803
Bump aws-sdk from 2.876.0 to 2.879.0 in /hedera-mirror-rest #1801
Bump eslint-plugin-jest from 24.3.2 to 24.3.4 in /hedera-mirror-rest #1800
Bump dependency-check-maven from 6.1.2 to 6.1.5 #1792
Bump aws-sdk from 2.871.0 to 2.876.0 in /hedera-mirror-rest #1790
Bump y18n from 4.0.0 to 4.0.1 in /hedera-mirror-rest/monitoring/monitor_apis #1789
Bump y18n from 4.0.0 to 4.0.1 in /hedera-mirror-rest #1788
Bump reporting-plugin from 4.0.98 to 4.0.101 #1782
Bump software.amazon.awssdk:bom from 2.16.26 to 2.16.31 #1781
Bump @hashgraph/proto from 1.0.22 to 1.0.23 in /hedera-mirror-rest/check-state-proof #1776
Bump frontend-maven-plugin from 1.11.2 to 1.11.3 #1773
Bump testcontainers from 7.6.2 to 7.7.0 in /hedera-mirror-rest #1771
Bump @hashgraph/proto from 1.0.22 to 1.0.23 in /hedera-mirror-rest #1769
Bump spring-boot-starter-parent from 2.4.3 to 2.4.4 #1765
Bump grpc-bom from 1.36.0 to 1.36.1 #1763
Bump mvn-golang-wrapper from 2.3.7 to 2.3.8 #1762
Bump dependency-check-maven from 6.1.2 to 6.1.3 #1761
Bump embedded.testcontainers.version from 2.0.4 to 2.0.5 #1760
Bump guava from 30.1-jre to 30.1.1-jre #1759
Bump software.amazon.awssdk:bom from 2.16.18 to 2.16.26 #1758
Bump sinon from 9.2.4 to 10.0.0 in /hedera-mirror-rest #1757
Bump aws-sdk from 2.863.0 to 2.871.0 in /hedera-mirror-rest #1756
Bump qs from 6.9.6 to 6.10.1 in /hedera-mirror-rest #1755
Bump husky from 5.1.3 to 5.2.0 in /hedera-mirror-rest #1754
Bump @hashgraph/proto from 1.0.21 to 1.0.22 in /hedera-mirror-rest #1753
Bump asn1js from 2.0.26 to 2.1.1 in /hedera-mirror-rest #1750
Bump @godaddy/terminus from 4.6.0 to 4.7.1 in /hedera-mirror-rest #1748
Bump @hashgraph/proto from 1.0.21 to 1.0.22 in /hedera-mirror-rest/check-state-proof #1735
Bump cucumber.version from 6.10.1 to 6.10.2 #1733
Bump embedded.testcontainers.version from 2.0.3 to 2.0.4 #1732
Bump reporting-plugin from 4.0.98 to 4.0.100 #1731
Bump spring-cloud-dependencies from 2020.0.1 to 2020.0.2 #1730
Bump testcontainers from 7.5.0 to 7.6.2 in /hedera-mirror-rest #1727
Bump eslint-plugin-jest from 24.3.1 to 24.3.2 in /hedera-mirror-rest #1726

Contributors
We'd like to thank all the contributors who worked on this release!

@xin-hedera
@Nana-EC
@dependabot[bot]
@ijungmann
@steven-sheehy